Benchmarks / Incident response

Incident response

Diagnose and mitigate failures in live systems, for example Kubernetes incidents.

Part of DevOps, SRE, and IT operations.

• AIOpsLabby Microsoft Research, UIUC, UC Berkeley and IIScTask level · Accuracy

  59.3%Flash · 12 Jan 2025

  Emerging
• EnterpriseOps-Gymby ServiceNow, Mila and Université de MontréalTask level · Task success rate

  45.9%Claude Opus 4.6 · 16 Mar 2026

  Emerging
• ITBenchby IBM Research and UIUCTask level · SRE incidents resolved

  25%ITBench-SRE-Agent-GPT-4o · 2 May 2025

  Emerging
• ITBench-AAby Artificial Analysis and IBM ResearchTask level · ITBench-AA score

  56.2%GPT-5.6 Sol (Max) · 10 Oct 2026

  Emerging
• SREGymby UIUC and University of TorontoTask level · End-to-end success rate

  72.2%GitHub Copilot (GPT-5.6 Sol, max) · 3 Aug 2026

  Strong