MemoryOnline
InfiniteBench
Evaluates language models on synthetic and realistic English and Chinese tasks with contexts averaging more than 100,000 tokens.
- Task count
- 12
Memory benchmarks
There are 10 memory in the index.
Results
10 benchmarks
MemoryOnline
LoCoMo
Evaluates very long-term conversational memory through question answering, event summarization, and dialogue generation.
- Task count
- 10
MemoryOnline
LongBench
Evaluates bilingual long-context understanding across single- and multi-document question answering, summarization, few-shot learning, and code.
- Task count
- 21
MemoryOnline
LongBench v2
Tests deep reasoning over realistic contexts from 8,000 to two million words using difficult multiple-choice questions.
- Task count
- 503
MemoryOnline
LooGLE
Tests short- and long-dependency understanding over recent documents longer than 24,000 tokens.
- Task count
- 6,000
MemoryOnline
MemBench
Evaluates agent memory effectiveness, efficiency, and capacity across factual and reflective memory in participation and observation settings.
MemoryOnline
MultiFieldQA
Tests single-document and multi-document question answering over long English and Chinese contexts within LongBench.
MemoryOnline
RULER
Measures effective context length with configurable synthetic tasks that go beyond simple needle retrieval.
- Task count
- 13
MemoryOnline
ZeroSCROLLS
Evaluates zero-shot understanding of long texts across summarization, question answering, aggregation, and reordering tasks.
- Task count
- 10
MemoryOnline
Needle In A Haystack
Tests whether a language model retrieves a planted fact from increasingly long contexts and at different insertion depths.
Other categories in Online
More benchmarks
Questions
What other kinds of benchmarks are in Online?
Other categories in Online: Multimodal (51 benchmarks), Reasoning (50 benchmarks), Agents (31 benchmarks), Safety (25 benchmarks), and Science (24 benchmarks).
Published by AI Benchmark Index. How we check each benchmark.