Benchmark archive
Reports
Long-form, dated analysis of Claude benchmark claims. Each report separates model, harness, effort setting, cost, source provenance, and what the score can actually prove.
Coding
Claude vs GPT Coding
A source-first comparison of Claude and GPT coding benchmark claims, with SWE-Bench Pro, Terminal-Bench, model availability, and effort settings separated.
Updated 2026-07-06 / 9 min
Methodology
SWE-Bench Pro vs Verified
A methodology report on SWE-Bench Verified, SWE-Bench Pro, contamination risk, resolve-rate metrics, and how Claude benchmark readers should interpret both.
Updated 2026-07-06 / 8 min
Agentic Coding
Terminal-Bench Agents
A report on Terminal-Bench 2.0, command-line agent evaluation, Claude and GPT leaderboard readings, and why model-only conclusions are risky.
Updated 2026-07-06 / 8 min
Cost
Cost and Context
A practical report on Claude and GPT pricing, context windows, output limits, effort controls, and why cost-per-answer is not the same as input-token price.
Updated 2026-07-06 / 8 min
Reasoning
Reasoning and Science
A report on academic reasoning, professional work, science-oriented benchmarks, and the limits of translating lab scores into operational Claude decisions.
Updated 2026-07-06 / 7 min
Multimodal
Documents and Vision
A report on multimodal benchmark claims, document workflows, OSWorld-style computer use, and what Claude and GPT comparisons miss when they focus only on text answers.
Updated 2026-07-06 / 7 min