# PubMedQA

PubMedQA is an AI benchmark; this page records what it measures and traces its data, grader, and scores to primary sources.

Evaluates biomedical research question answering from PubMed abstracts, including an expert-annotated test set.

## Details

- Address: Online, Global
- Website: [pubmedqa.github.io/](<https://pubmedqa.github.io/>)
- Tags: Helpful, Science
- Category: Science
- Status: Active
- Data licence: MIT
- Data access: open
- Grader: exact
- Organization: PubMedQA authors
- Released: 2019-09
- Paper: [arxiv.org/abs/1909.06146](<https://arxiv.org/abs/1909.06146>)
- Leaderboard: [pubmedqa.github.io/](<https://pubmedqa.github.io/>)
- Task count: 1,000
- Top-score provenance: unknown
- ABI family: No

## Questions

### Where is PubMedQA?

PubMedQA is at Online, Global.

### How do I contact PubMedQA?

To contact PubMedQA, visit https://pubmedqa.github.io/.

## Source

From [Benchmark primary sources](https://aibenchmarkindex.com/about), license CC0-1.0, checked 2026-10-15.

Last updated October 15, 2026.

## Links

- This benchmark on the [web page](<https://aibenchmarkindex.com/global/online/pubmedqa>)
- [Science in Online](<https://aibenchmarkindex.com/global/online/category/science.md>)
- [More benchmarks in Online](<https://aibenchmarkindex.com/global/online.md>)

> **Check before you compare.** Benchmark methods and leaderboards change. Follow the cited primary source before using a result in a decision.