· Paul Lukic
We Reran Our Benchmark With a Real Tokenizer. The Number Went Down. We're Publishing It.
Our headline claim was 79.7% token savings — one task, one fixture, bytes ÷ 4. The new harness runs 3 tasks with tiktoken and reports the median: 67.9%. Here's why the lower number is worth more, and what shipped with it.