200,000 Subscribers
Just saw that my blog reached 200,000 subscribers.
A big thank you to everyone who has been reading over the years and for all the encouraging feedback on my posts. It really kept me motivated to continue writing these long-form articles.
And an extra thank you to those who support this journey with a paid subscription. I really appreciate it. Your support makes this work as an independent researcher possible.
P.S. I am currently working on an exciting new article. If things go smoothly, it should be out next weekend.
Source: lightly edited website version of a note from my blog.
Read Next
Kimi K3 Architecture Notes
Short architecture note on Kimi K3, including LatentMoE, Kimi Delta Attention, Attention Residuals, NoPE, multimodality, and inference-efficiency choices.
A Few Notable Open-Weight Models This Week
Short note on the architectures of six new open-weight models, including Nanbeige 4.2, Laguna S 2.1, Motif-3-Beta, Solar Open 2, Antares 1B, and BTL-3.
Correction for Listing 6.5 in Build a Reasoning Model From Scratch
Short correction note for the random seed in Listing 6.5 on page 198 of Build a Reasoning Model From Scratch.