Budget the run
Choose and run an AI benchmark for a model decision. Lesson 3, 15 min.
Price the run before you send a request. Then put hard limits in the runner. The base estimate For a simple API evaluation, add two parts. - Input: tasks x average input tokens x input price per million tokens / 1,000,000. - Output: tasks x average output tokens x output price per million tokens / 1…
The rest of this lesson is for learners enrolled in the course. See how Choose and run an AI benchmark for a model decision works