# Benchmark Schema Mutation

Benchmark Schema Mutation is an AI benchmark; this page records what it measures and traces its data, grader, and scores to primary sources.

Measures whether a model calls the current version of a migrated tool schema instead of the one it memorized.

## Details

- Address: Online, Global
- Website: [github.com/pooriaarab/benchmark-schema-mutation](<https://github.com/pooriaarab/benchmark-schema-mutation>)
- Tags: Helpful
- Category: Tools
- Status: Alpha
- Data licence: MIT
- Data access: open
- Grader: exact
- Organization: Pooria Arab
- Released: 2026-10
- Leaderboard: [huggingface.co/datasets/pooria/benchmark-schema-mutation](<https://huggingface.co/datasets/pooria/benchmark-schema-mutation>)
- Repository: [github.com/pooriaarab/benchmark-schema-mutation](<https://github.com/pooriaarab/benchmark-schema-mutation>)
- npm package: benchmark-schema-mutation
- Task count: 60
- Top-score provenance: unknown
- ABI family: Yes

## Questions

### Where is Benchmark Schema Mutation?

Benchmark Schema Mutation is at Online, Global.

### How do I contact Benchmark Schema Mutation?

To contact Benchmark Schema Mutation, visit https://github.com/pooriaarab/benchmark-schema-mutation.

## Source

From [Benchmark primary sources](https://aibenchmarkindex.com/about), license CC0-1.0, checked 2026-10-16.

Last updated October 16, 2026.

## Links

- This benchmark on the [web page](<https://aibenchmarkindex.com/global/online/benchmark-schema-mutation>)
- [Tools in Online](<https://aibenchmarkindex.com/global/online/category/tools.md>)
- [More benchmarks in Online](<https://aibenchmarkindex.com/global/online.md>)

> **Check before you compare.** Benchmark methods and leaderboards change. Follow the cited primary source before using a result in a decision.