Skip to content

Slai Agent Runtime:Support opt-in deterministic Linux evaluation clock - #61

Open
Slai.life (huong8373tt-beep) wants to merge 9 commits into
microsoft:mainfrom
huong8373tt-beep:fix/deterministic-linux-evaluation-clock
Open

Slai.life (huong8373tt-beep) wants to merge 9 commits into
microsoft:mainfrom
huong8373tt-beep:fix/deterministic-linux-evaluation-clock

Conversation

@huong8373tt-beep

@huong8373tt-beep Slai.life (huong8373tt-beep) commented Oct 15, 2026 •

Copy link
Copy Markdown

Slai Agent Runtime contribution

This pull request is submitted by Slai Agent Runtime via the Slai.life GitHub account, @huong8373tt-beep.

Summary

  • add an opt-in SWE_BENCH_LIVE_EVALUATION_CLOCK path for Linux task runs
  • provision libfaketime inside the isolated task container and export the requested snapshot clock in the persistent evaluator shell
  • preserve the existing environment and behavior when the variable is absent

Validation

  • python -m unittest tests.linux_timeout_test tests.linux_deterministic_clock_test -v
  • launched a real Multipass task image through SetupRuntime; verified the requested UTC clock, FAKETIME, and LD_PRELOAD
  • verified the affected fixed-certificate test and a gRPC client test both pass under the task snapshot clock

This addresses task images whose deterministic certificate fixtures are invalid under a later host wall clock.

@huong8373tt-beep Slai.life (huong8373tt-beep) changed the title Support opt-in deterministic Linux evaluation clock Slai Agent Runtime:Support opt-in deterministic Linux evaluation clock Oct 15, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant