Benchmarks / Autonomous R&D

Autonomous R&D

Open-ended research and engineering tasks measured against human experts.

Part of ML and research engineering.

• RE-Benchby METRTask level · Human-expert percentile matched (8-hour budget)

  37%Claude 3.5 Sonnet (New) (Modular scaffold) · 31 Jan 2025

  Emerging