Sonnet 5.5
Anthropic · effort high · config sonnet-5-5-high-compact
- Overall
- 92
- Strict
- 56%
- $0.39 per solved task
- Gate pass
- 97%
- Cost / task
- $0.22
- Time / task
- 1m 28s
Quality
Cost and time
Hard tasks
100
99
100
100
100
100
100
98
100
26
100
100
100
100
100
89
93
89
92
84
79
96
100
96
100
89
100
96
100
Failures
- Mesh rebuild blender handle: 3 of 3 attempts failed a gate
This is an older run. See the current results.
Run kimi31-sonnet-hard2026-11-05commit 58201d93spend $50.99 + $14.79 AI judgingOther runs: 2026-11-05T05-50-12-kimi31-vs-sonnet, 2026-10-16T18-49-10-hard-compact-2026-10-16, 2026-09-23T06-56-16-hard-baseline-2026-09-23, 2026-09-10T19-44-23-baseline-2026-09, 2026-09-04T20-02-10-stage2-hard-cases, 2026-09-04T19-48-31-screen-14-fixed