Repository navigation
feat(connectors): add lichess/clock-blunder, chess clocks and evaluations with a blunder question - #834
Open
SudeepGowda55 wants to merge 3 commits into
Open
feat(connectors): add lichess/clock-blunder, chess clocks and evaluations with a blunder question#834SudeepGowda55 wants to merge 3 commits into
SudeepGowda55 wants to merge 3 commits into
Conversation
…f real games with a blunder question
… API Main changed the connector API. A label set carries its name as an annotation, a Hugging Face connector passes its Hub settings as class keywords and reads a mapping from part to path, BaseConnector names the whole download result, and Annotation takes its value by keyword. The dev group now lists zstandard, so ty finds it.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds
lichess/clock-blunder, a connector for real rated games from the Lichess open database (CC0).ClassificationTaskasks whether that player blunders within their next three moves (22.8% of the train windows are a yes).Why it matters:
Contributed as part of the TimeNet Online Hackathon (team Matcrypt).
Mapping
Record: one Record per window, at most 40 plies before the decision point, on an
OrdinalAxis(one value per ply).Clockswith the signalswhite_clockandblack_clock(seconds; a clock keeps its last value between its owner's moves), andEnginewithevaluation_pawns(clipped to ±10, so one mate does not dwarf the window).time_control,white_elo,black_elo,side_to_move,ply. The Lichess game id is in the record metadata. Player names are not kept.Task: a
ClassificationTaskover the label setblunder_within_three_moves(no,yes).2 / (1 + exp(-0.00368208 * centipawns)) - 1and a forced mate counted as +1 or -1. The label is computed from the evaluations; it is not read from the PGN's??glyphs, and the two differ on some moves.Source and determinism
requirements.txtaddszstandard(BSD-3-Clause) to decompress the dump.Testing
tests/test_connector.py, none of which uses the network: synthetic PGN compressed with zstandard, including a mate evaluation, a berserk start, an increment control, a game without evaluations, a game cut off without a result and a game too short for a window, plus a round trip through the writer and reader.make check,make test-connectors(all 13 connectors),ty check --python-version 3.11andmake license-checkpass locally. I did not runmake test, since the change adds a connector and touches no core code.timenet-build build lichess/clock-blundertakes about a minute and produces the counts above.