Benchmarks / Infrastructure as code

Infrastructure as code

Write and change Terraform, Kubernetes manifests, and similar configuration.

Part of DevOps, SRE, and IT operations.

• IaC-Evalby University of Michigan and Cisco ResearchTask level · pass@1

  36.7%GPT-4 with retrieval-augmented generation · 2024

  Emerging