IDEAS, DECISIONS & LESSONS
Notes on AI, architecture and building useful products.
4 articles
25 Aug 2026 · 4 min read
ai-agents
Microsoft's new agent benchmark stopped grading transcripts and started checking database state instead. A 65% first-try success rate that collapses to 25% over 20 tries should change how technical leads think about agent reliability testing.
Read more21 Jul 2026 · 4 min read
ai
Moonshot AI's Kimi K3 just beat Claude Fable 5 on Frontend Code Arena. Here's how to evaluate any new open-weight model release as a Tech Lead — from benchmarks to real production tasks.
Read more21 Jun 2026 · 7 min read
ai
How to build AI evaluation pipelines that catch problems before production. The 3-tier eval framework, dataset curation, model-as-judge patterns, and CI/CD integration.
Read more27 Feb 2026 · 9 min read
azure
Bonus Part 8 — Testing real-time voice AI is notoriously hard. Learn strategies for mocking, latency benchmarking, and LLM-as-judge evaluation. Then build a transcript analysis system that generates a scored interview report with specific action items.
Read more
