Benchmarks / Incident response

Incident response

Diagnose and mitigate failures in live systems, for example Kubernetes incidents.

Part of DevOps, SRE, and IT operations.

• AIOpsLabby Microsoft Research, UIUC, UC Berkeley and IIScTask level · Accuracy

  59.3%Flash · 12 Jan 2025

  Emerging
• ITBenchby IBM Research and UIUCTask level · SRE incidents resolved

  25%ITBench-SRE-Agent-GPT-4o · 2 May 2025

  Emerging
• ITBench-AAby Artificial Analysis and IBM ResearchTask level · ITBench-AA score

  47%Claude Opus 4.7 (Adaptive Reasoning, Max Effort) · 27 May 2026

  Emerging
• SREGymby UIUC and University of TorontoTask level · End-to-end success rate

  72.2%GitHub Copilot (GPT-5.6 Sol, max) · 2026

  Strong