From 9791e4280e3a1148b27aaf3fca4a8c86a09667df Mon Sep 17 00:00:00 2001 From: cy948 Date: Thu, 29 Oct 2026 22:22:42 +0800 Subject: [PATCH 1/4] docs: add leaderboard and Harbor Hub links to README --- README.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/README.md b/README.md index 7e8c2c0..3cd400a 100644 --- a/README.md +++ b/README.md @@ -45,6 +45,21 @@ In scope are **usability** problems that show up in use — for example memory d --- +## Leaderboard + +Snapshot of the [published leaderboard](https://ibench.ai/leaderboard) as of 29 Oct 2026. Pass rates are measured across all 44 tasks; each result links to its recorded run on Harbor Hub. + +| Model | Harness | Pass rate (passed / total) | Harbor Hub | +| --- | --- | ---: | --- | +| GPT-6 Astra | Codex | 34.1% (15/44) | [View run](https://hub.harborframework.com/jobs/f54d076c-070d-5533-92fc-80b403e39c3a) | +| Claude Opus 5.5 | Claude Code | 27.3% (12/44) | [View run](https://hub.harborframework.com/jobs/58add739-5535-5189-9002-8c1a98a9dfe0) | +| DeepSeek Flash | DSH | 15.9% (7/44) | [View run](https://hub.harborframework.com/jobs/23ef15c8-109a-5a90-b83e-49918df1e509) | +| GLM-5.3 Flash | ZCode | 9.1% (4/44) | [View run](https://hub.harborframework.com/jobs/8e9dbe3b-2a3f-57b4-910b-b7ca7e2f6c25) | +| Qwen3.8 Max | Codex | 6.8% (3/44) | [View run](https://hub.harborframework.com/jobs/ee425524-01bf-54f9-b08d-8a55114fed3e) | +| Kimi K3 | Kimi Code | 4.5% (2/44) | [View run](https://hub.harborframework.com/jobs/4e94ddee-4be9-513d-b914-48339687b59f) | + +--- + ## Quickstart ### 1) Clone and install From 22fa91feea18c8867012dfd6b2dec80c9b7f8a3f Mon Sep 17 00:00:00 2001 From: cy948 Date: Thu, 29 Oct 2026 22:27:54 +0800 Subject: [PATCH 2/4] docs: simplify leaderboard preview note --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 3cd400a..3b7081a 100644 --- a/README.md +++ b/README.md @@ -47,7 +47,7 @@ In scope are **usability** problems that show up in use — for example memory d ## Leaderboard -Snapshot of the [published leaderboard](https://ibench.ai/leaderboard) as of 29 Oct 2026. Pass rates are measured across all 44 tasks; each result links to its recorded run on Harbor Hub. +> v0.1 preview, full public [leaderboard](https://ibench.ai/leaderboard) | Model | Harness | Pass rate (passed / total) | Harbor Hub | | --- | --- | ---: | --- | From 452f47e7121c2fd42867fa055dd5048a687254ae Mon Sep 17 00:00:00 2001 From: cy948 Date: Thu, 29 Oct 2026 22:29:24 +0800 Subject: [PATCH 3/4] docs: update README slogan --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 3b7081a..2d3d73e 100644 --- a/README.md +++ b/README.md @@ -3,7 +3,7 @@ # Interaction Bench -**Can coding agents figure out why people struggle with interfaces?** +**Benchmarked on what users feel.** [![Website](https://img.shields.io/badge/Website-ibench.ai-4285F4?style=for-the-badge&logo=google-chrome&logoColor=white)](https://ibench.ai) [![Leaderboard](https://img.shields.io/badge/Leaderboard-000000?style=for-the-badge&logo=mdbook&color=105864)](https://ibench.ai/leaderboard) From 0a9d91f04d3dd2c1122937c40508098dbd956ab3 Mon Sep 17 00:00:00 2001 From: cy948 Date: Thu, 29 Oct 2026 22:35:52 +0800 Subject: [PATCH 4/4] docs: rename leaderboard trajectory links --- README.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index 2d3d73e..8af61f6 100644 --- a/README.md +++ b/README.md @@ -49,14 +49,14 @@ In scope are **usability** problems that show up in use — for example memory d > v0.1 preview, full public [leaderboard](https://ibench.ai/leaderboard) -| Model | Harness | Pass rate (passed / total) | Harbor Hub | +| Model | Harness | Pass rate (passed / total) | Trajectory | | --- | --- | ---: | --- | -| GPT-6 Astra | Codex | 34.1% (15/44) | [View run](https://hub.harborframework.com/jobs/f54d076c-070d-5533-92fc-80b403e39c3a) | -| Claude Opus 5.5 | Claude Code | 27.3% (12/44) | [View run](https://hub.harborframework.com/jobs/58add739-5535-5189-9002-8c1a98a9dfe0) | -| DeepSeek Flash | DSH | 15.9% (7/44) | [View run](https://hub.harborframework.com/jobs/23ef15c8-109a-5a90-b83e-49918df1e509) | -| GLM-5.3 Flash | ZCode | 9.1% (4/44) | [View run](https://hub.harborframework.com/jobs/8e9dbe3b-2a3f-57b4-910b-b7ca7e2f6c25) | -| Qwen3.8 Max | Codex | 6.8% (3/44) | [View run](https://hub.harborframework.com/jobs/ee425524-01bf-54f9-b08d-8a55114fed3e) | -| Kimi K3 | Kimi Code | 4.5% (2/44) | [View run](https://hub.harborframework.com/jobs/4e94ddee-4be9-513d-b914-48339687b59f) | +| GPT-6 Astra | Codex | 34.1% (15/44) | [View in harborhub](https://hub.harborframework.com/jobs/f54d076c-070d-5533-92fc-80b403e39c3a) | +| Claude Opus 5.5 | Claude Code | 27.3% (12/44) | [View in harborhub](https://hub.harborframework.com/jobs/58add739-5535-5189-9002-8c1a98a9dfe0) | +| DeepSeek Flash | DSH | 15.9% (7/44) | [View in harborhub](https://hub.harborframework.com/jobs/23ef15c8-109a-5a90-b83e-49918df1e509) | +| GLM-5.3 Flash | ZCode | 9.1% (4/44) | [View in harborhub](https://hub.harborframework.com/jobs/8e9dbe3b-2a3f-57b4-910b-b7ca7e2f6c25) | +| Qwen3.8 Max | Codex | 6.8% (3/44) | [View in harborhub](https://hub.harborframework.com/jobs/ee425524-01bf-54f9-b08d-8a55114fed3e) | +| Kimi K3 | Kimi Code | 4.5% (2/44) | [View in harborhub](https://hub.harborframework.com/jobs/4e94ddee-4be9-513d-b914-48339687b59f) | ---