Skip to content

Build a shortlist

Choose and run an AI benchmark for a model decision. Lesson 2, 15 min.

Use this order. Each step removes benchmarks that cannot support your decision. 1. Reject tasks that do not match the decision. 2. Reject graders that cannot tell apart the failures that matter. 3. Check that the data licence and access terms allow your run. 4. Prefer benchmarks with room below the…

The rest of this lesson is for learners enrolled in the course. See how Choose and run an AI benchmark for a model decision works

Published by . How we check each benchmark.

The benchmark newsletter

Updates on benchmarks and reported scores.

We only use your email to send this newsletter. Privacy policy.