Skip to content

BigCodeBench vs CodeXGLUE

Select two to four listings to compare their details.

Scroll sideways to see all listings.

NameBigCodeBenchCodeXGLUE
City and regionOnline, GlobalOnline, Global
CategoriesCodingCoding
Phone——
Websitehttps://github.com/bigcode-project/bigcodebenchhttps://github.com/microsoft/CodeXGLUE
Tierfreefree
TagsHelpful, ScienceHelpful, Science
CategoryCodingCoding
StatusActiveActive
Saturation——
Data licenceApache-2.0MIT
Data accessopenopen
Graderunit-testmixed
OrganizationBigCodeBench TeamMicrosoft Research
Released2024-062020-08
Paperhttps://arxiv.org/abs/2406.15877https://arxiv.org/abs/2102.04664
Leaderboardhttps://huggingface.co/spaces/bigcode/bigcodebench-leaderboardhttps://microsoft.github.io/CodeXGLUE/
Repositoryhttps://github.com/bigcode-project/bigcodebenchhttps://github.com/microsoft/CodeXGLUE
npm package——
Task count1,14010
Top-score provenanceunknownunknown
Top score——
Top-score source——
ABI familyNoNo

Published by . How we check each benchmark.

The benchmark newsletter

Updates on benchmarks and reported scores.

We only use your email to send this newsletter. Privacy policy.