MathOnline
GSM8K
Tests multi-step arithmetic reasoning on human-written grade-school math word problems.
- Task count
- 8,500
AI Benchmark Index catalogs 6 math with source-linked metadata.
6 benchmarks
MathOnline
Tests multi-step arithmetic reasoning on human-written grade-school math word problems.
MathOnline
Tests competition-level mathematical problem solving across algebra, counting, geometry, number theory, and related subjects.
MathOnline
Tests mathematical reasoning on 500 held-out problems sampled from the MATH test split.
MathOnline
Evaluates grade-school mathematical reasoning on the same 250 problems translated by human annotators into 10 languages.
MathOnline
Tests automated theorem provers on olympiad and classroom mathematics translated across formal systems.
MathOnline
Tests autoformalization and formal proving of undergraduate mathematics in Lean from natural-language statements.
Published by AI Benchmark Index. How we check each benchmark.