tagged · 2 articles

security

2026

What your evals never read
Your eval suite scores the function. It never reads the sentence the model reads before deciding to call that function, and that sentence is the one that can lie, be tampered with after you ship, or be obeyed differently on the very next run. First in a series on what agent evals actually have to measure.
Aug 6, 2026
2026

The numbers and the trust trail: benchmarking waitbus honestly
Two kinds of trust in one place — the benchmark methodology that makes the speed numbers survive a skeptic (Coordinated Omission, a bimodal p99, costs published as losses), and the supply-chain trail that lets you trust the artifact you install (SLSA provenance, sigstore, reproducible builds, and an honest list of the gaps).
Jun 14, 2026