Skip to content

Math benchmarks

There are 6 math in the index.

Results

6 benchmarks

  • MathOnline

    GSM8K

    Tests multi-step arithmetic reasoning on human-written grade-school math word problems.

    Task count
    8,500

  • MathOnline

    MATH

    Tests competition-level mathematical problem solving across algebra, counting, geometry, number theory, and related subjects.

    Task count
    12,500

  • MathOnline

    MATH-500

    Tests mathematical reasoning on 500 held-out problems sampled from the MATH test split.

    Task count
    500

  • MathOnline

    MGSM

    Evaluates grade-school mathematical reasoning on the same 250 problems translated by human annotators into 10 languages.

    Task count
    2,500

  • MathOnline

    miniF2F

    Tests automated theorem provers on olympiad and classroom mathematics translated across formal systems.

    Task count
    488

  • MathOnline

    ProofNet

    Tests autoformalization and formal proving of undergraduate mathematics in Lean from natural-language statements.

    Task count
    371

Other categories in Online

More benchmarks

Questions

What other kinds of benchmarks are in Online?

Other categories in Online: Multimodal (51 benchmarks), Reasoning (50 benchmarks), Agents (31 benchmarks), Safety (25 benchmarks), and Science (24 benchmarks).

Published by . How we check each benchmark.