Repository navigation
feat(connectors): add EMIP programmer gaze dataset - #839
Draft
Flamour555 wants to merge 1 commit into
Draft
Flamour555 wants to merge 1 commit into
Flamour555 wants to merge 1 commit into
Conversation
Add emip/programmer-gaze: eye fixations of 216 programmers reading two short programs (EMIP, Bednarik et al. 2020, CC-BY-4.0). One record per code-reading trial with four irregular series (gaze x/y in px, fixation duration in ms, pupil diameter in mm) and one ClassificationTask whose target is the self-reported programming expertise (none/low/medium/high). Fixations come from an I-DT pass over the right-eye 250 Hz samples (<= 25 px dispersion, >= 80 ms); samples where the tracker lost the eye end the running fixation. The archive is pinned by sha256. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Author
|
Forks can't set labels, so could a maintainer add `area:connectors`? Thanks! |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
A connector for EMIP, the Eye Movements in Programming dataset (Bednarik et al., 2020;
CC-BY-4.0; https://osf.io/53kts). As far as I can tell, it is the first eye-tracking / program-comprehension
dataset in TimeNet.
emip/programmer-gaze: 216 programmers each read two short programs (rectangle,vehicle)in Java, Python or Scala on an SMI RED250 tracker at 250 Hz.
fixation: gaze
xandy(px), fixationduration(ms), and meanpupildiameter (mm). Timeoffsets are µs since the stimulus appeared.
ClassificationTaskper record. The target is the participant's self-reportedexpertise_programming: none / low / medium / high (11 / 45 / 120 / 40 participants).comprehension answer was correct.
Record.metadatakeepsparticipant_id, so users can makesubject-disjoint splits. The release defines no split, so the connector imposes none.
How fixations are derived
The release ships raw gaze samples, not fixations. The connector runs a dispersion-threshold
(I-DT) pass over the right-eye samples:
A sample is invalid when the tracker flags it, when the point of regard is off-screen, or when the
pupil is ≤ 0. The tracker reports a lost eye as a "valid" sample at (0, 0) with pupil 0, so the last
two checks are needed. An invalid sample ends the running fixation. Trials with no fixation get no
record: 9 of the 432 trials, from very noisy tracking. For example, participant 2 has ~15 px
sample-to-sample jitter. No value is filled or repaired.
A trial runs from the stimulus image message to the next image message. Mouse-click messages
don't end a trial.
Files
The archive is pinned by sha256 (
716c035b…9968). The connector has no extra requirements; ituses only numpy and the standard library.
Verification
ruff format --check,ruff check(repo-wide) andty checkon the connector: clean.timenet-build build emip/programmer-gaze --local-registry …: built 1.0.0. The record countmatches the connector's direct conversion of the real archive (423 records and tasks), and the
release reads back with
TimeNet(...).open(...).makewas unavailable, so I ran the ruff/ty/pytest commands directly. One existingtest,
tests/test_build_env.py::test_uv_command_passes_the_requirements_file, fails on Windowsonly: it compares
\fake\reqs.txtwith/fake/reqs.txt. It is unrelated to this change.Context
Built for GlanceNet, a hackathon project that classifies programmer expertise from fixation
sequences with OpenTSLM-SP. The connector stands on its own; nothing in it is specific to that model.
🤖 Generated with Claude Code