Skip to content

Math benchmarks

AI Benchmark Index catalogs 6 math with source-linked metadata.

Results

6 benchmarks

  • MathOnline

    GSM8K

    Tests multi-step arithmetic reasoning on human-written grade-school math word problems.

    Task count
    8,500
  • MathOnline

    MATH

    Tests competition-level mathematical problem solving across algebra, counting, geometry, number theory, and related subjects.

    Task count
    12,500
  • MathOnline

    MATH-500

    Tests mathematical reasoning on 500 held-out problems sampled from the MATH test split.

    Task count
    500
  • MathOnline

    MGSM

    Evaluates grade-school mathematical reasoning on the same 250 problems translated by human annotators into 10 languages.

    Task count
    2,500
  • MathOnline

    miniF2F

    Tests automated theorem provers on olympiad and classroom mathematics translated across formal systems.

    Task count
    488
  • MathOnline

    ProofNet

    Tests autoformalization and formal proving of undergraduate mathematics in Lean from natural-language statements.

    Task count
    371

Math by city

Related categories

Questions

Which cities have the most math?

The cities with the most math are Online, Global (6 benchmarks).

Published by . How we check each benchmark.