Benchmarks / Feature development

Feature development

Add new behavior to an existing codebase or build an app from a spec.

Part of Software engineering.

• Aider Polyglot leaderboardby AiderTask level · Percent correct

  88%gpt-5 (high) · 23 Aug 2025

  Strong
• SWE-Bench Proby Scale AITask level · Resolve rate (public set)

  61.5%Muse Spark 1.1 · 9 Jul 2026

  Retired
• SWE-Bench Pro V2by Scale AI and ReflectionTask level · Resolve rate (V2 Full)

  99.4%Opus 5 (Claude Code) xhigh · 22 Sep 2026

  Saturated
• SWE-Lancerby OpenAITask level · IC SWE Diamond pass@1

  80%gpt-5.1-codex-max · 18 Nov 2025

  Strong
• Terminal-Bench 2.0by Laude Institute and Stanford UniversityTask level · Resolution rate

  84.7%NexAU-AHE + GPT-5.5 · 23 Apr 2026

  Retired
• Terminal-Bench 4.0by Laude Institute and Stanford UniversityTask level · Resolution rate

  64.8%Claude Code + Opus 5.5 (max) · 6 Oct 2026

  Strong
• TheAgentCompanyby Carnegie Mellon UniversityTask level · Tasks resolved

  42.9%TTE-MatrixAgent + DeepSeek-V3.2 · 10 Nov 2025

  Emerging