Skip to content

Tools benchmarks

There are 6 tools in the index.

Results

6 benchmarks

  • ToolsOnline

    AppWorld

    Measures interactive coding agents on tasks spanning simulated everyday apps and their APIs.

  • ToolsOnline

    BIRD-SQL

    Tests text-to-SQL generation against large database contents spanning many professional domains.

    Task count
    12,751

  • ToolsOnline

    Spider

    Tests cross-domain text-to-SQL generalization to unseen database schemas and complex queries.

    Task count
    10,181

  • ToolsOnline

    tau-bench

    Measures customer-service agents through policy-constrained conversations and database tool use.

  • ToolsOnline

    tau2-bench

    Measures conversational agents when both the user and agent can change shared task state.

  • ToolsOnline

    Benchmark Tool Errors

    Tests retries, idempotency, and recovery after simulated API failures.

Other categories in Online

More benchmarks

Questions

What other kinds of benchmarks are in Online?

Other categories in Online: Multimodal (51 benchmarks), Reasoning (50 benchmarks), Agents (31 benchmarks), Safety (25 benchmarks), and Science (24 benchmarks).

Published by . How we check each benchmark.