HALV × SWE-rebench · September 30, 2026
Inspect all 42 pairs.
14 tasks, three repetitions each. HALV: $144.67 and 25/42 passes. Vanilla: $337.50 and 25/42 passes.
These are sanitized records from an interim, self-published workflow comparison. Costs include selected failed runs and every recorded worker session. Infrastructure-invalid attempts and the rolled-back policy experiment are excluded. Some excluded costs remain unknown.
| Task | Rep. | Pass V/H | Vanilla cost | HALV cost | Records |
|---|---|---|---|---|---|
| ArcadeDB-4281 | 1 | 0 / 1 | $4.3393 | $2.6751 | Vanilla · HALV |
| ArcadeDB-4281 | 2 | 1 / 1 | $3.5581 | $2.1977 | Vanilla · HALV |
| ArcadeDB-4281 | 3 | 1 / 1 | $3.3616 | $2.6222 | Vanilla · HALV |
| ArcadeDB-4411 | 1 | 1 / 1 | $4.6428 | $2.3373 | Vanilla · HALV |
| ArcadeDB-4411 | 2 | 1 / 1 | $5.8267 | $3.0490 | Vanilla · HALV |
| ArcadeDB-4411 | 3 | 1 / 1 | $3.3352 | $2.0592 | Vanilla · HALV |
| ArcadeDB-4455 | 1 | 1 / 1 | $23.1353 | $4.6292 | Vanilla · HALV |
| ArcadeDB-4455 | 2 | 1 / 1 | $34.7545 | $5.9390 | Vanilla · HALV |
| ArcadeDB-4455 | 3 | 1 / 1 | $23.9599 | $4.4062 | Vanilla · HALV |
| gentle-ai-595 | 1 | 1 / 1 | $1.4499 | $2.6827 | Vanilla · HALV |
| gentle-ai-595 | 2 | 1 / 1 | $3.4652 | $2.0176 | Vanilla · HALV |
| gentle-ai-595 | 3 | 1 / 1 | $3.2173 | $2.4920 | Vanilla · HALV |
| nanobot-4048 | 1 | 1 / 1 | $1.2738 | $1.8190 | Vanilla · HALV |
| nanobot-4048 | 2 | 1 / 1 | $1.6528 | $2.0564 | Vanilla · HALV |
| nanobot-4048 | 3 | 1 / 1 | $1.7768 | $1.8340 | Vanilla · HALV |
| nanobot-4129 | 1 | 1 / 1 | $1.3189 | $2.3165 | Vanilla · HALV |
| nanobot-4129 | 2 | 1 / 1 | $1.4039 | $1.4006 | Vanilla · HALV |
| nanobot-4129 | 3 | 1 / 1 | $1.6741 | $1.7659 | Vanilla · HALV |
| nanobot-4274 | 1 | 0 / 0 | $3.9768 | $4.4325 | Vanilla · HALV |
| nanobot-4274 | 2 | 0 / 0 | $3.7586 | $4.3296 | Vanilla · HALV |
| nanobot-4274 | 3 | 0 / 0 | $3.4303 | $5.8004 | Vanilla · HALV |
| lossless-claw-814 | 1 | 0 / 0 | $6.6350 | $3.4644 | Vanilla · HALV |
| lossless-claw-814 | 2 | 0 / 0 | $7.1764 | $5.2621 | Vanilla · HALV |
| lossless-claw-814 | 3 | 0 / 0 | $6.8484 | $3.2451 | Vanilla · HALV |
| Perry-3982 | 1 | 1 / 0 | $22.8139 | $6.2946 | Vanilla · HALV |
| Perry-3982 | 2 | 1 / 0 | $23.4808 | $6.8082 | Vanilla · HALV |
| Perry-3982 | 3 | 1 / 1 | $24.9033 | $4.8000 | Vanilla · HALV |
| codex-lb-744 | 1 | 1 / 1 | $3.6740 | $4.0942 | Vanilla · HALV |
| codex-lb-744 | 2 | 1 / 1 | $4.5490 | $3.2171 | Vanilla · HALV |
| codex-lb-744 | 3 | 1 / 1 | $3.2322 | $3.4616 | Vanilla · HALV |
| agno-8148 | 1 | 0 / 0 | $12.5021 | $3.8989 | Vanilla · HALV |
| agno-8148 | 2 | 0 / 0 | $12.2702 | $2.5337 | Vanilla · HALV |
| agno-8148 | 3 | 0 / 0 | $7.4627 | $2.4126 | Vanilla · HALV |
| dubbo-go-3357 | 1 | 0 / 0 | $2.7716 | $3.7904 | Vanilla · HALV |
| dubbo-go-3357 | 2 | 0 / 0 | $1.8445 | $3.1495 | Vanilla · HALV |
| dubbo-go-3357 | 3 | 0 / 0 | $2.9876 | $2.8955 | Vanilla · HALV |
| hugegraph-3037 | 1 | 1 / 1 | $15.6308 | $3.5756 | Vanilla · HALV |
| hugegraph-3037 | 2 | 1 / 1 | $7.8412 | $4.9131 | Vanilla · HALV |
| hugegraph-3037 | 3 | 0 / 1 | $13.5778 | $3.7171 | Vanilla · HALV |
| pulsar-25793 | 1 | 0 / 0 | $5.7532 | $3.4632 | Vanilla · HALV |
| pulsar-25793 | 2 | 0 / 0 | $8.0940 | $3.4535 | Vanilla · HALV |
| pulsar-25793 | 3 | 0 / 0 | $8.1405 | $3.3537 | Vanilla · HALV |