BIRD-SQL vs tau-bench
Select two to four listings to compare their details.
Scroll sideways to see all listings.
| Name | BIRD-SQL | tau-bench |
|---|---|---|
| City and region | Online, Global | Online, Global |
| Categories | Tools | Tools |
| Phone | — | — |
| Website | https://bird-bench.github.io/ | https://github.com/sierra-research/tau-bench |
| Tier | free | free |
| Tags | Helpful, Science | Helpful, Science |
| Category | Tools | Tools |
| Status | Active | Retired |
| Saturation | — | — |
| Data licence | CC-BY-SA-4.0 | MIT |
| Data access | open | open |
| Grader | exact | simulation |
| Organization | BIRD Team | Sierra Research |
| Released | 2023-05 | 2024-06 |
| Paper | https://arxiv.org/abs/2305.03111 | https://arxiv.org/abs/2406.12045 |
| Leaderboard | https://bird-bench.github.io/ | — |
| Repository | https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/bird | https://github.com/sierra-research/tau-bench |
| npm package | — | — |
| Task count | 12,751 | — |
| Top-score provenance | unknown | unknown |
| Top score | — | — |
| Top-score source | — | — |
| ABI family | No | No |
Published by AI Benchmark Index. How we check each benchmark.