Benchmarks / Data engineering and SQL

Data engineering and SQL

Write SQL and data pipelines against real schemas and warehouses.

Part of Data and analytics.

• BIRD-Interactby HKU and Google CloudTask level · Success rate, a-Interact, Full, both phases

  22.7%MERIT + GPT-5.4 (GPT-4o user simulator) · 22 May 2026

  Emerging
• HealthAgentBenchby Microsoft ResearchTask level · Task success rate

  55%Claude Code (Opus 5) · 27 Jul 2026

  Emerging
• MCPMark Verifiedby EVAL SYS, LobeHub and NUS TRAILTask level · Pass@1 (single run)

  96.1%kimi-k3-max · 20 Jul 2026

  Saturated
• Spider 2.0by HKU and Salesforce AI ResearchTask level · Execution accuracy (Spider 2.0-Snow)

  96.7%Genloop's Sentinel Agent v2 Pro · 1 Mar 2026

  Saturated