Benchmarks / Shipping pull requests

Shipping pull requests

Real pull requests from agents on public repositories, and what happens to them.

Part of Software engineering.

• AIDevby Queen's UniversityTask level · PR acceptance rate (AIDev-pop)

  65.3%OpenAI Codex · 20 Jul 2025

  Unrated
• PR Arenaby aavetisTask level · Merge rate of ready PRs

  96%Copilot · 23 Sep 2026

  Unrated
• Will It Survive? Agent code survival studyby Concordia UniversityTask level · Line-level modification (death) rate

  No result recorded

  No results yet