Jobs / Software engineering

Can agents do software engineering work?

Build, test, and maintain software, from issue fixes to whole applications.

US jobs
2,150,380 (1.4% of employment)
Typical wage
$129K a year (employment-weighted mean of occupation medians)
Occupations
7 in O*NET 31.0
Evidence
20 benchmarks from 19 institutions

Task level

Strong

On fresh or held-out issue sets, the best agents resolve most tasks: 61.5% on SWE-Bench Pro (public set) and 64.5% on SWE-rebench. Limits: the SWE-Bench Pro private set is lower (51.5%), agent PRs in popular repositories are accepted less often than human PRs (65.3% vs 76.8% in AIDev), and GPT-5 cheated on 54% of impossible tasks in ImpossibleBench.

Evidence: SWE-Bench Pro, SWE-rebench, SWE-Lancer, Aider Polyglot leaderboard, Code Review Bench, Ambig-SWE, AIDev, PR Arena, ImpossibleBench, METR Task-Completion Time Horizons — by aavetis, Aider, Anthropic, Carnegie Mellon University, Martian, METR, Nebius, OpenAI, Queen's University, and Scale AI. Reading dated 23 Sep 2026.

Agents succeed on most benchmark tasks. Limits remain in reliability, scope, or cost.

Project level

Not yet

Whole projects are mostly out of reach. On the Remote Labor Index, the best agent completed 15.8% of paid freelance projects to a standard a client would accept. In CodeClash, where agents evolve their own codebases over many rounds, a human-written bot beat the best model in 150 of 150 rounds. GDPval deliverables score higher, but those tasks are one-shot and fully specified.

Evidence: Remote Labor Index, CodeClash, GDPval, GDPval-AA — by Artificial Analysis, CAIS, OpenAI, Princeton University, Scale AI, and Stanford University. Reading dated 23 Sep 2026.

The best agents fail most tasks on the best available benchmarks.

Share:Post on XRedditImage (PNG)Permalink
Embed this card

The image names the institutions behind the numbers and links back to this page.

HTML:

<a href="https://canagentswork.com/jobs/software-engineering/"><img src="https://canagentswork.com/og/jobs-software-engineering.png" width="600" height="315" alt="Can agents do software engineering work? Task level: Strong. Project level: Not yet." loading="lazy"></a>

Markdown:

[![Can agents do software engineering work? Task level: Strong. Project level: Not yet.](https://canagentswork.com/og/jobs-software-engineering.png)](https://canagentswork.com/jobs/software-engineering/)

Benchmarks for this work

Also relevant

These benchmarks cover part of this family's work.

Functions: Feature developmentShipping pull requestsAsking for clarificationIssue resolutionCode reviewCodebase evolutionLong-horizon autonomyVulnerability researchProfessional deliverablesTest integrityFreelance projectsData engineering and SQLTerminal operationsEnterprise workflows

What we do not know

Occupations in this family

Sorted by US employment (BLS OEWS May 2025). O*NET sub-occupations share the employment figure of their SOC group.

OccupationSOCUS jobs
Software Developers15-1252.001.7M
Blockchain Engineers15-1299.07(435K group)
Software Quality Assurance Analysts and Testers15-1253.00187K
Video Game Designers15-1255.01(113K group)
Web and Digital Interface Designers15-1255.00113K
Computer Programmers15-1251.0092K
Web Developers15-1254.0070K
How to cite

Credit the original work first: the benchmarks listed on this page, and their institutions.

Then, if you used this page:

Can Agents Work. "Can agents do software engineering work?." https://canagentswork.com/jobs/software-engineering/ (accessed 2026-09-24). CC BY 4.0.
@misc{caw-jobs-software-engineering,
  title        = {{Can agents do software engineering work?}},
  author       = {{Can Agents Work}},
  year         = {2026},
  howpublished = {\url{https://canagentswork.com/jobs/software-engineering/}},
  note         = {Accessed 2026-09-24. CC BY 4.0}
}