# Tools benchmarks

There are 6 tools in the index.

6 benchmarks. Also on the [web page](https://aibenchmarkindex.com/global/online/category/tools).

## Benchmarks

1. [AppWorld](https://aibenchmarkindex.com/global/online/appworld.md), Tools, Online: Measures interactive coding agents on tasks spanning simulated everyday apps and their APIs.
2. [BIRD-SQL](https://aibenchmarkindex.com/global/online/bird-sql.md), Tools, Online: Tests text-to-SQL generation against large database contents spanning many professional domains.
3. [Spider](https://aibenchmarkindex.com/global/online/spider.md), Tools, Online: Tests cross-domain text-to-SQL generalization to unseen database schemas and complex queries.
4. [tau-bench](https://aibenchmarkindex.com/global/online/tau-bench.md), Tools, Online: Measures customer-service agents through policy-constrained conversations and database tool use.
5. [tau2-bench](https://aibenchmarkindex.com/global/online/tau2-bench.md), Tools, Online: Measures conversational agents when both the user and agent can change shared task state.
6. [Benchmark Tool Errors](https://aibenchmarkindex.com/global/online/benchmark-tool-errors.md), Tools, Online: Tests retries, idempotency, and recovery after simulated API failures.

## Other categories in Online

- [Multimodal](https://aibenchmarkindex.com/global/online/category/multimodal.md): 51 benchmarks
- [Reasoning](https://aibenchmarkindex.com/global/online/category/reasoning.md): 50 benchmarks
- [Agents](https://aibenchmarkindex.com/global/online/category/agents.md): 31 benchmarks
- [Safety](https://aibenchmarkindex.com/global/online/category/safety.md): 25 benchmarks
- [Science](https://aibenchmarkindex.com/global/online/category/science.md): 24 benchmarks
- [Coding](https://aibenchmarkindex.com/global/online/category/coding.md): 17 benchmarks
- [Retrieval](https://aibenchmarkindex.com/global/online/category/retrieval.md): 17 benchmarks
- [Memory](https://aibenchmarkindex.com/global/online/category/memory.md): 10 benchmarks
- [Browser](https://aibenchmarkindex.com/global/online/category/browser.md): 7 benchmarks
- [Voice](https://aibenchmarkindex.com/global/online/category/voice.md): 7 benchmarks
- [Math](https://aibenchmarkindex.com/global/online/category/math.md): 6 benchmarks
- [Other](https://aibenchmarkindex.com/global/online/category/other.md): 6 benchmarks
- [Commerce](https://aibenchmarkindex.com/global/online/category/commerce.md): 4 benchmarks
- [Long-horizon](https://aibenchmarkindex.com/global/online/category/long-horizon.md): 3 benchmarks

> **Check before you compare.** Benchmark methods and leaderboards change. Follow the cited primary source before using a result in a decision.