AgentsOnline
Habitat HomeRobot OVMM Challenge
Measures open-vocabulary mobile manipulation systems that find objects, navigate, and rearrange them in simulated homes.
There are 31 agents in the index.
31 benchmarks
AgentsOnline
Measures open-vocabulary mobile manipulation systems that find objects, navigate, and rearrange them in simulated homes.
AgentsOnline
Evaluates strategic planning, adaptation, and robustness through head-to-head model competitions in chess, poker, and Werewolf.
AgentsOnline
Tests whether agents complete end-to-end tasks inside reproducible terminal environments.
AgentsOnline
Tests agents on valuable containerized work such as debugging, security fixes, and scientific workflows.
AgentsOnline
Measures reinforcement-learning agents in generated text-based games with controllable difficulty and scope.
AgentsOnline
Evaluates model deception, deduction, persuasion, and turn-taking through arena-style social-deduction games.
AgentsOnline
Measures dollars, retries, and tokens consumed per verified model result.
Published by AI Benchmark Index. How we check each benchmark.