IDEAS, DECISIONS & LESSONS

Journal

Notes on AI, architecture and building useful products.

Explore AI Ideas & Solutions

18 articles

· 4 min read

ai-security

155 Leaked Responses: Inside Cloudflare's GLM-5.3 KV-Cache Bug

Cloudflare's GLM-5.3 deployment advertised a 1.05M-token context window backed by a 681K-token cache. The gap, plus an SGLang bug, leaked 155 responses across tenants. What the incident report actually says, and what it means for anyone running multi-tenant inference.

Read more

· 4 min read

cloudflare

Cloudflare Cut DNS Cache Memory by 56% — The Rust Layout Tricks Worth Stealing

On Aug 27, Cloudflare shipped five memory-layout optimizations to Big Pineapple, their DNS cache, cutting per-entry memory by 56% and freeing ~100TB fleet-wide. A Tech Lead's walkthrough of the actual techniques — struct packing, arena allocation, string interning — and where they pay off in ordinary backend services, not just DNS resolvers at Cloudflare scale.

Read more