LongBench v2
LongBench v2 is an AI benchmark; this page records what it measures and traces its data, grader, and scores to primary sources.
Tests deep reasoning over realistic contexts from 8,000 to two million words using difficult multiple-choice questions.
- Address
- Online, Global
- Website
- longbench2.github.io/
- Tags
- Helpful, Science
- Category
- Memory
- Status
- Active
- Data licence
- MIT
- Data access
- open
- Grader
- exact
- Organization
- THUDM
- Released
- 2024-12
- Leaderboard
- longbench2.github.io/
- Repository
- github.com/THUDM/LongBench
- Task count
- 503
- Top-score provenance
- unknown
- ABI family
- No
Questions
Where is LongBench v2?
How do I contact LongBench v2?
More benchmarks in Online
SafetyOnline
AdvBench
Measures whether adversarial suffixes induce aligned language models to produce targeted harmful behavior.
- Task count
- 520
AgentsOnline
AgentBench
Measures language-model agents across operating systems, databases, games, web shopping, and other interactive environments.
- Task count
- 8
SafetyOnline
AgentDojo
Evaluates agent task utility and resistance to prompt injection while agents use tools over untrusted data.
- Task count
- 97
ReasoningOnline
AGIEval
Tests general problem solving with questions from 20 public admission, qualification, and competition exams.
- Task count
- 20
AgentsOnline
AI2-THOR
Evaluates embodied agents in interactive simulated indoor scenes with object manipulation and navigation.
AgentsOnline
ALFWorld
Measures agents that learn high-level policies in text environments and execute the same household goals in embodied worlds.