Skip to content

BBQ-Lite vs BeaverTails

Select two to four listings to compare their details.

Scroll sideways to see all listings.

NameBBQ-LiteBeaverTails
City and regionOnline, GlobalOnline, Global
CategoriesSafetySafety
Phone——
Websitehttps://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/bbq_lite_jsonhttps://github.com/PKU-Alignment/beavertails
Tierfreefree
TagsScienceHelpful, Science
CategorySafetySafety
StatusActiveActive
Saturation——
Data licenceApache-2.0Apache-2.0
Data accessopenopen
Graderexactexact
OrganizationBIG-bench contributorsPKU-Alignment
Released2021-092023-07
Paperhttps://arxiv.org/abs/2206.04615https://arxiv.org/abs/2307.04657
Leaderboard——
Repositoryhttps://github.com/google/BIG-benchhttps://github.com/PKU-Alignment/beavertails
npm package——
Task count—330,000
Top-score provenanceunknownunknown
Top score——
Top-score source——
ABI familyNoNo

Published by . How we check each benchmark.

The benchmark newsletter

Updates on benchmarks and reported scores.

We only use your email to send this newsletter. Privacy policy.