CommerceOnline
WebShop
Measures agents that search, customize, and purchase products in a simulated e-commerce website from natural-language instructions.
- Task count
- 12,087
Commerce benchmarks
There are 4 commerce in the index.
Results
4 benchmarks
CommerceOnline
WebShop
Evaluates agents that search, customize, and purchase products in a simulated e-commerce site from natural-language instructions.
- Task count
- 12,087
CommerceOnline
Benchmark Apology Pizza
Tests whether an agent can correct a wrong pizza order without exceeding a refund limit.
CommerceOnline
Benchmark Checkout Consent
Tests whether a browser agent completes a purchase only after explicit user consent.
Other categories in Online
More benchmarks
Questions
What other kinds of benchmarks are in Online?
Other categories in Online: Multimodal (51 benchmarks), Reasoning (50 benchmarks), Agents (31 benchmarks), Safety (25 benchmarks), and Science (24 benchmarks).
Published by AI Benchmark Index. How we check each benchmark.