Benchmarks / Research replication

Research replication

Reproduce or extend published research results.

Part of ML and research engineering.

• CORE-Benchby Princeton UniversityTask level · CORE-Bench-Hard accuracy (public test set)

  95.5%Claude Code + Claude Opus 4.5 (after manual regrading) · 3 Dec 2025

  Solved
• PaperBenchby OpenAIProject level · Average replication score

  26%IterativeAgent o1-high (36h limit) · 2 Apr 2025

  Emerging