Skip to content

Align raw task instructions with reference format - #26

Merged
hanhainebula merged 1 commit into
VectorSpaceLab:mainfrom
hr-jin:align-raw-instructions
Oct 23, 2026
Merged

hanhainebula merged 1 commit into
VectorSpaceLab:mainfrom
hr-jin:align-raw-instructions

Conversation

@hr-jin

@hr-jin hr-jin commented Oct 23, 2026

Copy link
Copy Markdown
Collaborator

Summary

Task names and package paths: the 13 existing tasks/<name>/raw-instruction.md files listed below.
Goal, starting system, and CPU/GPU requirements: align author-facing task descriptions with the reference format; task resources and execution limits are unchanged.
Authors and coauthors: Haoran Jin; existing task authors and contributor history are preserved.

khmer-embedding-training, financial-report-qa, evolving-personal-memory, document-page-search, layout-page-search, visual-document-qa, composed-image-search, sketch-text-search, same-place-image-search, video-moment-search, narrative-clue-search, spoken-query-search, icsi-meeting-memory.

Standardize section order, command examples and artifact descriptions. Keep JSONL examples on one line, clarify existing failure handling, replace unclear quality descriptions with task-specific explanations and README references, and remove duplicated evaluation paragraphs.

Only raw-instruction.md files change. Agent-facing instruction.md files, data, interfaces, scoring rules and executable code remain unchanged.

Validation evidence

Checks use base 125d63be79c04903e06cc6f6896bfe667351d22e.

  • python scripts/check_tasks.py tasks/<name> --merge-ready --base 125d63be79c04903e06cc6f6896bfe667351d22e: all 13 task checks passed, 0 errors.
  • python scripts/check_release.py: 0 errors, 0 warnings.
  • git diff --check: passed.
  • Shell examples pass bash -n; command arguments and parsed JSON example values are preserved. Referenced README anchors exist.
  • Three independent reviews of the final documentation passed.
  • Runtime experiments were not repeated: this change only updates author-facing documentation.

Contributor checklist

  • Existing descriptive task names and tasks/<task-name> paths are preserved; no new tasks are introduced.
  • Actual authors in task.toml; original author commits preserved.
  • Allow edits from maintainers.
  • No secrets, downloaded inputs/models, job outputs, trajectories or author-only solutions.
  • Static checks and applicable documentation validation recorded.
  • Asset manifests and provenance files are unchanged; this PR uploads no data.

Maintainer merge checklist

  • Design, verifier isolation, runtime evidence and any validation exceptions reviewed.
  • Names checked against the current base and queued PRs.
  • Upstream or official asset downloads verified against immutable pins, sizes and SHA-256 hashes.
  • If official publication is needed: new assets published under tasks/<task-name>/, previous assets preserved and merged official SHA pinned.
  • Task-local docs/configuration complete; no shared task inventory updates needed.
  • Required judges, credential isolation and failure cases validated; checks and merge-ready pass.
  • Merge commit; original contributor history retained.

Standardize sections and examples for thirteen tasks, clarify existing failure handling, and remove duplicated or undefined descriptions. Runtime instructions, interfaces and scoring rules are unchanged.
@hanhainebula
hanhainebula merged commit 8cc2a7e into VectorSpaceLab:main Oct 23, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants