evaluations

An agent reads a sentence about your tool and decides, on that sentence, to call it. Your tests read the function. What a passing suite is evidence of, and what it is not.

01

What your evals never read
Your eval suite scores the function. It never reads the sentence the model reads before deciding to call that function, and that sentence is the one that can lie, be tampered with after you ship, or be obeyed differently on the very next run. First in a series on what agent evals actually have to measure.
Aug 6, 2026