Contamination and test freshness

Contamination means that benchmark content, or content close to it, was in the data a model learned from. Research on contamination shows that models can sometimes recover benchmark-specific content. Contamination is not the same as saturation. Both can raise scores without proof that the skill gene…

The rest of this lesson is for learners enrolled in the course. See how Audit AI benchmark claims before you buy works