# Math benchmarks

AI Benchmark Index catalogs 6 math with source-linked metadata.

6 benchmarks. Also on the [web page](https://aibenchmarkindex.com/category/math).

## Benchmarks

1. [GSM8K](https://aibenchmarkindex.com/global/online/gsm8k.md), Math, Online: Tests multi-step arithmetic reasoning on human-written grade-school math word problems.
2. [MATH](https://aibenchmarkindex.com/global/online/math.md), Math, Online: Tests competition-level mathematical problem solving across algebra, counting, geometry, number theory, and related subjects.
3. [MATH-500](https://aibenchmarkindex.com/global/online/math-500.md), Math, Online: Tests mathematical reasoning on 500 held-out problems sampled from the MATH test split.
4. [MGSM](https://aibenchmarkindex.com/global/online/mgsm.md), Math, Online: Evaluates grade-school mathematical reasoning on the same 250 problems translated by human annotators into 10 languages.
5. [miniF2F](https://aibenchmarkindex.com/global/online/minif2f.md), Math, Online: Tests automated theorem provers on olympiad and classroom mathematics translated across formal systems.
6. [ProofNet](https://aibenchmarkindex.com/global/online/proofnet.md), Math, Online: Tests autoformalization and formal proving of undergraduate mathematics in Lean from natural-language statements.

## Math by city

- [Online, Global](https://aibenchmarkindex.com/global/online/category/math.md): 6 benchmarks

## Related categories

- [Multimodal](https://aibenchmarkindex.com/category/multimodal.md): 51 benchmarks
- [Reasoning](https://aibenchmarkindex.com/category/reasoning.md): 50 benchmarks
- [Agents](https://aibenchmarkindex.com/category/agents.md): 31 benchmarks
- [Safety](https://aibenchmarkindex.com/category/safety.md): 25 benchmarks
- [Science](https://aibenchmarkindex.com/category/science.md): 24 benchmarks
- [Coding](https://aibenchmarkindex.com/category/coding.md): 17 benchmarks
- [Retrieval](https://aibenchmarkindex.com/category/retrieval.md): 17 benchmarks
- [Memory](https://aibenchmarkindex.com/category/memory.md): 10 benchmarks
- [Browser](https://aibenchmarkindex.com/category/browser.md): 7 benchmarks
- [Voice](https://aibenchmarkindex.com/category/voice.md): 7 benchmarks
- [Other](https://aibenchmarkindex.com/category/other.md): 6 benchmarks
- [Tools](https://aibenchmarkindex.com/category/tools.md): 6 benchmarks
- [Commerce](https://aibenchmarkindex.com/category/commerce.md): 4 benchmarks
- [Long-horizon](https://aibenchmarkindex.com/category/long-horizon.md): 3 benchmarks

> **Check before you compare.** Benchmark methods and leaderboards change. Follow the cited primary source before using a result in a decision.
