# Retrieval benchmarks There are 17 retrieval in the index. 17 benchmarks. Also on the [web page](https://aibenchmarkindex.com/global/online/category/retrieval). ## Benchmarks 1. [BEIR](https://aibenchmarkindex.com/global/online/beir.md), Retrieval, Online: Evaluates zero-shot information retrieval across heterogeneous datasets, domains, and retrieval architectures. 2. [CRUD-RAG](https://aibenchmarkindex.com/global/online/crud-rag.md), Retrieval, Online: Evaluates retrieval-augmented generation across create, read, update, and delete application scenarios. 3. [FActScore](https://aibenchmarkindex.com/global/online/factscore.md), Retrieval, Online: Measures the factual precision of long-form generations by decomposing them into atomic claims and checking each claim against a knowledge source. 4. [FEVER](https://aibenchmarkindex.com/global/online/fever.md), Retrieval, Online: Tests whether systems verify Wikipedia-based claims as supported, refuted, or lacking enough evidence. 5. [FinanceBench](https://aibenchmarkindex.com/global/online/financebench.md), Retrieval, Online: Evaluates open-book financial question answering against answers and evidence drawn from public company filings. 6. [FreshQA](https://aibenchmarkindex.com/global/online/freshqa.md), Retrieval, Online: Evaluates answers to questions whose facts change over time or were never present in a model’s training data. 7. [KILT](https://aibenchmarkindex.com/global/online/kilt.md), Retrieval, Online: Evaluates knowledge-intensive language tasks while requiring answers and provenance grounded in one Wikipedia snapshot. 8. [LegalBench-RAG](https://aibenchmarkindex.com/global/online/legalbench-rag.md), Retrieval, Online: Evaluates whether retrieval systems return minimal, precisely located evidence for complex legal contract questions. 9. [MIRACL](https://aibenchmarkindex.com/global/online/miracl.md), Retrieval, Online: Evaluates monolingual information retrieval across 18 languages using native-speaker relevance judgments. 10. [MMTEB](https://aibenchmarkindex.com/global/online/mmteb.md), Retrieval, Online: Measures multilingual text embeddings across more than 500 quality-controlled tasks covering over 250 languages. 11. [MS MARCO](https://aibenchmarkindex.com/global/online/ms-marco.md), Retrieval, Online: Evaluates machine reading, answer generation, and passage or document ranking using questions sampled from Bing search. 12. [MTEB](https://aibenchmarkindex.com/global/online/mteb.md), Retrieval, Online: Measures text embeddings across classification, clustering, retrieval, reranking, similarity, and summarization tasks. 13. [RAGChecker](https://aibenchmarkindex.com/global/online/ragchecker.md), Retrieval, Online: Diagnoses retrieval-augmented generation systems with claim-level metrics for their retrieval and generation components. 14. [RAGTruth](https://aibenchmarkindex.com/global/online/ragtruth.md), Retrieval, Online: Evaluates hallucination detection in retrieval-augmented answers using human annotations at response and word levels. 15. [WebWalkerQA](https://aibenchmarkindex.com/global/online/webwalkerqa.md), Retrieval, Online: Measures long-horizon information seeking through multi-hop traversal of structured websites. 16. [TREC Deep Learning Track](https://aibenchmarkindex.com/global/online/trec-deep-learning-track.md), Retrieval, Online: Evaluates passage and document ranking systems on large web collections with graded relevance judgments. 17. [Natural Questions](https://aibenchmarkindex.com/global/online/natural-questions.md), Retrieval, Online: Evaluates question answering on real Google queries paired with annotated evidence and answers from Wikipedia pages. ## Other categories in Online - [Multimodal](https://aibenchmarkindex.com/global/online/category/multimodal.md): 51 benchmarks - [Reasoning](https://aibenchmarkindex.com/global/online/category/reasoning.md): 50 benchmarks - [Agents](https://aibenchmarkindex.com/global/online/category/agents.md): 31 benchmarks - [Safety](https://aibenchmarkindex.com/global/online/category/safety.md): 25 benchmarks - [Science](https://aibenchmarkindex.com/global/online/category/science.md): 24 benchmarks - [Coding](https://aibenchmarkindex.com/global/online/category/coding.md): 17 benchmarks - [Memory](https://aibenchmarkindex.com/global/online/category/memory.md): 10 benchmarks - [Browser](https://aibenchmarkindex.com/global/online/category/browser.md): 7 benchmarks - [Voice](https://aibenchmarkindex.com/global/online/category/voice.md): 7 benchmarks - [Math](https://aibenchmarkindex.com/global/online/category/math.md): 6 benchmarks - [Other](https://aibenchmarkindex.com/global/online/category/other.md): 6 benchmarks - [Tools](https://aibenchmarkindex.com/global/online/category/tools.md): 6 benchmarks - [Commerce](https://aibenchmarkindex.com/global/online/category/commerce.md): 4 benchmarks - [Long-horizon](https://aibenchmarkindex.com/global/online/category/long-horizon.md): 3 benchmarks > **Check before you compare.** Benchmark methods and leaderboards change. Follow the cited primary source before using a result in a decision.