#benchmarks
POSTS
- Livenerf: a day-0 baseline for the 'they nerfed it' argument
The 'they nerfed it' argument never ends because nobody has a day-0 baseline, so it's vibes versus vibes. What I like here is the…
- Opus 5.5 tops the index, but the bill is tokens times price
The number I care about here isn't 58. It's the note that Opus tokens are much cheaper than Astra's, while Astra needs far fewer of them.…
- The 17 GB version is the one I'd actually run
I have been talking myself out of a bigger GPU for months, and this settles it. Q4KM of Qwen3.8 27B is 17 GB, matches full BF16 on…
- One token a second, and the SSDs are the bottleneck I didn't expect
The number I keep staring at isn't 1.00 tok/s. It's the drive ladder: one SSD gives ~52% of four-drive speed, two ~73%, three ~90%. That's…
- Two Cents a Task Changes What You Bother Automating
The number that stopped me wasn't 89.0% on ARC-AGI-1. It was $0.02 per task. I've spent the last year writing prompts as if every call were…