Skip to content

Science benchmarks

There are 24 science in the index.

Results

24 benchmarks

  • ScienceOnline

    GEO-Bench

    Compares pretrained models on a standardized suite of geospatial Earth-monitoring classification and segmentation datasets.

    Task count
    6
  • ScienceOnline

    GPQA

    Tests expert-level reasoning on graduate biology, physics, and chemistry questions designed to resist web search.

    Task count
    448
  • ScienceOnline

    LIBERO

    Measures knowledge transfer in lifelong robot learning across manipulation task suites with controlled distribution shifts.

    Task count
    130
  • ScienceOnline

    ManiSkill

    Measures generalizable robotic manipulation policies in scalable simulated environments.

  • ScienceOnline

    Matbench

    Evaluates machine-learning models on 13 curated materials-property prediction tasks.

    Task count
    13
  • ScienceOnline

    Matbench Discovery

    Compares the accuracy, robustness, and computational cost of models used for atomistic and materials-discovery tasks.

  • ScienceOnline

    MedMCQA

    Evaluates medical multiple-choice reasoning on questions drawn from Indian medical entrance examinations.

    Task count
    194,000
  • ScienceOnline

    MedQA

    Evaluates medical knowledge and reasoning with multiple-choice questions from professional medical licensing exams.

    Task count
    61,097
  • ScienceOnline

    Meta-World

    Measures multi-task and meta-reinforcement learning across robotic manipulation tasks and goal variations.

    Task count
    50
  • ScienceOnline

    MMLU Medical Subjects

    Evaluates factual knowledge and problem solving across the medical and biomedical subject sets in MMLU.

  • ScienceOnline

    Mol-Instructions

    Evaluates instruction-following across molecule description, property prediction, reaction, and biomolecular tasks.

  • ScienceOnline

    OlympiadBench

    Tests bilingual, multimodal problem solving on olympiad-level mathematics and physics questions.

    Task count
    8,476
  • ScienceOnline

    Procgen Benchmark

    Measures sample efficiency and generalization in reinforcement learning across procedurally generated game environments.

    Task count
    16
  • ScienceOnline

    RLBench

    Measures robot learning across vision-guided manipulation tasks in a simulated environment.

  • ScienceOnline

    robomimic

    Measures robot policies learned from offline human demonstrations across standardized datasets and tasks.

  • ScienceOnline

    robosuite

    Provides standardized simulated robot manipulation environments for evaluating learning methods.

  • ScienceOnline

    ScienceWorld

    Measures text-based agents on tasks grounded in an elementary science curriculum.

    Task count
    30
  • ScienceOnline

    SciFact

    Tests retrieval of scientific evidence and classification of research claims as supported or refuted.

  • ScienceOnline

    Vendi Score

    Measures diversity in a collection from pairwise similarities using the effective rank of a similarity matrix.

  • ScienceOnline

    AI2 Reasoning Challenge

    Tests grade-school science reasoning with natural multiple-choice questions split into easy and challenge sets.

    Task count
    7,787
  • ScienceOnline

    MultiMedQA

    Evaluates medical question answering across seven datasets spanning professional exams, research, and consumer health queries.

    Task count
    7
  • ScienceOnline

    PubMedQA

    Evaluates biomedical research question answering from PubMed abstracts, including an expert-annotated test set.

    Task count
    1,000
  • ScienceOnline

    SciBench

    Evaluates college-level scientific reasoning, domain knowledge, and calculation on textbook problems.

    Task count
    692

Other categories in Online

More benchmarks

Questions

What other kinds of benchmarks are in Online?

Other categories in Online: Multimodal (51 benchmarks), Reasoning (50 benchmarks), Agents (31 benchmarks), Safety (25 benchmarks), and Coding (17 benchmarks).

Published by . How we check each benchmark.