slimshetty/gso repository overview

⁠GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents

GSO (Global Software Optimization) is a benchmark for evaluating language models' capabilities in developing high-performance software. We present 102 challenging optimization tasks across 10 codebases spanning diverse domains and programming languages. Each task provides a codebase and performance test as a precise specification, with agents required to optmize the codebase and measured against expert developer commit. Here we provide pre-built docker containers for each of the 102 tasks.