Matched cases
The same 87 bug-fix cases ran against both agents on identical checkouts.
Benchmarks
Faster. Cheaper. Verified.
87 matched bug-fix cases on identical checkouts, Codna against Cursor. Codna verified 87 of 87 at about $0.02 per fix, with 5× fewer tokens and 1.7× faster.
| Metric | Codna | Cursor |
|---|---|---|
| Fixes verified | 87 / 87 | 87 / 87 |
| Matched cases | 87 | 87 |
| Average wall time | 13.39s | 22.57s |
| Average tokens per fix | 16,159 | 80,971 |
| Average model cost per fix | $0.021 | n/a |
| Repo understanding | 0 tokens | Model context |
5×fewer tokens than Cursor per fix: 16,159 against 80,971.
1.7×faster than Cursor per fix: 13.39 s against 22.57 s.
$0.02per verified fix on average: $0.021 over 87 cases.
Methodology
Real bugs. Real repos. Matched cases.
Each case ran on an identical checkout for both agents. A case counts only when the fix verified. The table reports averages over the 87 matched cases.
Average tokens per fix
Codna averaged 16,159 total tokens per fix. Cursor averaged 80,971.
Average wall time
Codna averaged 13.39 seconds per fix. Cursor averaged 22.57 seconds.
Per verified fix
Codna averaged $0.021 of model spend per verified fix.
Averages over 87 matched bug-fix cases on identical checkouts. A case counts only when the fix verified. Download the summary (JSON) →
Frequently asked
Codna ran head-to-head against Cursor on 87 matched bug-fix cases, each on an identical checkout. Token totals, wall time and model cost were recorded per case and averaged.
A case counts only when the fix verified. Codna verified 87 of 87. Cursor verified 87 of 87.
16,159 total tokens per fix on average, against 80,971 for Cursor. Codna also prints the raw-to-bundle context size on every run, so you can see the number for your own repo.
Codna maps the dependency and blast-radius graph without a model, for zero tokens. The agent receives only the relevant evidence, so there is less to read before a fix is produced.
$0.021 of model spend per verified fix on average over the 87 cases. With your own key you pay your provider directly.
Codna is bring-your-own-key, so you choose the model for your own runs. Set the provider with codna key set, or pass --model provider/model. The default planner is repository.verified_agentic_v1.
Verify it in your repo.
codna fix . --issue "the failing test"