partforge

Which models can actually do CAD?

2 models, 29 tasks, 174 attempts. Each attempt is graded on whether it built, on measured geometry, and on a checklist an AI judge answers from the renders. Click any number to open the attempt behind it.

Quality
against
0%25%50%75%100%$0.00$0.10$0.20$0.30$0.400s50s1m 40s2m 30s3m 20sSonnet 5.5Kimi K3.1 Pro
Sonnet 5.5 sits alone in the top-left corner: first on strict pass and the cheapest to run. The share of attempts that got everything right: built, every gate, every measured check, every AI judge criterion.

Read this gap with care

This run limited Kimi K3.1 Pro to 32,000 output tokens per response. On the articulated figure task, two of its three attempts reached that limit in their first response and built nothing. That one task is most of the gap between the two models: without it, both score about 92.

We then raised Kimi's limit to 60,000 and ran that task six more times on its own. All six passed the gates and none reached the limit. The task's mean score rose from 29 to 89, against 98 for Sonnet 5.5. The attempts also cost more and took longer: $1.30 and about 12.7 minutes each, up from $0.54 and about 5 minutes.

Those six attempts are not in the numbers on this page. Using their score for that task would put Kimi at about 91.6 against Sonnet's 92.4, but that is an estimate, not a measured run.

All models

Rank by
#ModelQualityCost and timeOverallStrictGate pass
1Sonnet 5.5Anthropic
9256%97%
2Kimi K3.1 ProModal
8953%93%

Overall gives partial credit at every layer, so the top of the board bunches. Strict counts only the attempts that got everything right. Gate pass is the share whose part was watertight, hole-correct and overlap-free. Hover any bar for its number. Ties break by cost, then time.

Browse the tasks

How the score is made

Built 30%, measured geometry 50%, AI judge 20%. A failed gate zeroes geometry for that attempt. The AI judges are Opus 5.5 and GPT-6 Sol. Read the methodology.