Blog
In total, I've written 14 articles on this site. Search by title below, or pick a category.
Subscribe to Blog
No spam ever, only raw unfilered throughts and new blog post alerts.
Interactive
Explore Z.ai's GLM-5.3 in an interactive 3D animation: how it chooses which parts of a conversation to read, builds an answer and guesses ahead to save work.
Explore Xiaomi's MiMo-V2.6-Pro in an interactive 3D animation: how tokens, attention, a mixture of experts and speculative decoding produce an answer.
Take a night drive through Kimi K3 as an interactive 3D city: follow one token through Kimi Delta Attention, MLA, attention residuals and 896 experts.
Take the red pill and follow one token through DeepSeek V4-Pro in interactive 3D: compressed attention, hyper-connections, 384 experts and 61 layers.
Press start and watch a large language model finish a sentence in an interactive visualization: tokens, attention, the KV cache and mixture of experts.