Skip to content

AlpacaEval vs ARC-AGI-1

Select two to four listings to compare their details.

Scroll sideways to see all listings.

NameAlpacaEvalARC-AGI-1
City and regionOnline, GlobalOnline, Global
CategoriesReasoningReasoning
Phone——
Websitehttps://github.com/tatsu-lab/alpaca_evalhttps://github.com/fchollet/ARC-AGI
Tierfreefree
TagsHelpful, ScienceViral, Science
CategoryReasoningReasoning
StatusActiveActive
Saturation——
Data licenceApache-2.0Apache-2.0
Data accessopenopen
Graderllm-judgeexact
OrganizationStanford CRFMFrançois Chollet
Released2023-052019-11
Paperhttps://arxiv.org/abs/2404.04475https://arxiv.org/abs/1911.01547
Leaderboardhttps://tatsu-lab.github.io/alpaca_eval/https://arcprize.org/leaderboard
Repositoryhttps://github.com/tatsu-lab/alpaca_evalhttps://github.com/fchollet/ARC-AGI
npm package——
Task count805800
Top-score provenanceunknownunknown
Top score——
Top-score source——
ABI familyNoNo

Published by . How we check each benchmark.

The benchmark newsletter

Updates on benchmarks and reported scores.

We only use your email to send this newsletter. Privacy policy.