SWE-bench
Real GitHub issues as coding-agent tasks.
SWE-bench measures whether models can patch real open-source repositories from issue descriptions. It is the standard reference for software engineering agent benchmarks.
- Price
- Open benchmark and evaluation harness; compute is yours.
- Model
- free
- Platforms
- Web
- Category
- Coding
Published by AI Benchmark Index. How we check each benchmark.