Repository navigation
Add GPU device selection, upgrade harnesses, and standardize task docs - #29
Merged
Merged
Conversation
Select a shared GPU UUID for agent and verifier phases. Upgrade Codex, Claude Code, Pi, and the RewardKit Codex runtime with compatibility checks. Normalize all task READMEs and versions, and align scaffolding and contributor guidance.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Make GPU selection available through the common evaluation command, refresh the coding-agent runtimes, and give all 49 existing task packages a consistent README and version baseline. Update the evaluation guides, contribution guidance, task scaffolding, and maintainer checks to match.
GPU selection
--gpu-device <host-index-or-GPU-UUID>for all 23 GPU tasks. Resolve the device once and use the same UUID for the agent and separate verifier.query-encoder-alignmentonto the common interface and document selection in the English/Chinese READMEs, evaluation guides, and GPU task READMEs.For example, select host GPU 2 using the existing evaluation command:
Harness updates
0.164.0, Claude Code to2.1.309, and Pi to1.4.0across the launcher, adapters, all 49 agent images, documentation, and tests. Centralize the launcher pins inscripts/harness_versions.pyand support Pi'smaxthinking level.0.164.0, including verifier installation and audit-user cache paths.0.22.0and RewardKit at0.2.0. The RewardKit wrapper uses a version-guarded override of its internal Codex pin; future RewardKit upgrades require revalidating that integration.Task documentation
1.0.0and record2026-10-23 | 1.0.0 | Added initial task. Remove duplicate legacy version declarations from the README prose. Preserve historical validation reports and their original versions, scores, and dates.Validation evidence
python scripts/check_tasks.py: 0 errors.python -m unittest discover -s scripts/tests -p 'test_*.py': 181 tests, 179 passed, 2 skipped because RewardKit is absent from the host environment. The RewardKit integration was separately checked in an existing verifier container.python .agents/skills/create-searchswe-task/scripts/test_scaffold_task.py: 5 passed. Both task skills passed skill validation.git diff --checkpassed.docker inspectcaptures were not retained in the review evidence bundle, so these observations are distinct from the independently reproduced Compose checks.Validation was intentionally limited to static checks, automated tests, and minimal runtime/protocol checks. Full task evaluations were not run. Real external model API connectivity remains unverified because credentials were unavailable.
The documentation follow-up removes two stale inline version declarations in
decision-model-trainingandlightweight-query-retrieval. All 49 task README versions, section structures, and initial changelogs were rechecked againsttask.toml; the follow-up diff contains only those two removals and passesgit diff --check. Historical trial text and reports remain byte-for-byte unchanged. Runtime tests were not repeated for this documentation-only correction.Contributor checklist
Maintainer merge checklist
main.