Skip to content

CALVIN vs LiveBench 2.0

Select two to four listings to compare their details.

Scroll sideways to see all listings.

NameCALVINLiveBench 2.0
City and regionOnline, GlobalOnline, Global
CategoriesLong-horizonLong-horizon
Phone——
Websitehttps://github.com/mees/calvinhttps://livebench.ai/
Tierfreefree
TagsHelpful, ScienceHelpful, Science
CategoryLong-horizonLong-horizon
StatusActiveAlpha
Saturation——
Data licenceMITunknown
Data accessopennone
Gradersimulationmixed
OrganizationCALVIN teamLiveBench
Released2021-072026-09
Paperhttps://arxiv.org/abs/2112.03227—
Leaderboard—https://livebench.ai/
Repositoryhttps://github.com/mees/calvin—
npm package——
Task count——
Top-score provenanceunknownunknown
Top score——
Top-score source——
ABI familyNoNo

Published by . How we check each benchmark.

The benchmark newsletter

Updates on benchmarks and reported scores.

We only use your email to send this newsletter. Privacy policy.