APPS vs BigCodeBench
Select two to four listings to compare their details.
Scroll sideways to see all listings.
| Name | APPS | BigCodeBench |
|---|---|---|
| City and region | Online, Global | Online, Global |
| Categories | Coding | Coding |
| Phone | — | — |
| Website | https://github.com/hendrycks/apps | https://github.com/bigcode-project/bigcodebench |
| Tier | free | free |
| Tags | Helpful, Science | Helpful, Science |
| Category | Coding | Coding |
| Status | Active | Active |
| Saturation | — | — |
| Data licence | MIT | Apache-2.0 |
| Data access | open | open |
| Grader | unit-test | unit-test |
| Organization | Hendrycks et al. | BigCodeBench Team |
| Released | 2021-05 | 2024-06 |
| Paper | https://arxiv.org/abs/2105.09938 | https://arxiv.org/abs/2406.15877 |
| Leaderboard | — | https://huggingface.co/spaces/bigcode/bigcodebench-leaderboard |
| Repository | https://github.com/hendrycks/apps | https://github.com/bigcode-project/bigcodebench |
| npm package | — | — |
| Task count | 10,000 | 1,140 |
| Top-score provenance | unknown | unknown |
| Top score | — | — |
| Top-score source | — | — |
| ABI family | No | No |
Published by AI Benchmark Index. How we check each benchmark.