Reasoning Models From Scratch: Code Setup
A little video that
- explains the relationship between conventional LLMs and reasoning models (and agents),
- philosophizes about “from scratch” approaches,
- and explains how to install the Python and PyTorch requirements with
uv.
The video is here: Build A Reasoning Model From Scratch #1: Motivation & Code Setup.
Source: website version of my Substack note.
Read Next
Focusing on Post-Training
Why I'd invest in post-training existing open-weight LLMs, with Fireworks' Ember-1 as an example of more token-efficient reasoning.
MiMo-V2.6 Pro Architecture and Training Notes
Notes on MiMo-V2.6 Pro's GQA and sliding-window attention, agent training tasks, reward signals, and large RL batches.
It's Easy to Dismiss Jev as Just a Classifier
A short note on Jev's generalization, possible encoder-style architecture and training, and Choice and Noul API examples.