flâneur

Tiny Interaction Models - Rajan Agarwal

rajan.sh · 2,903 words · saved by 5 readers

Post-training a small open model to process typing as a live stream, so it can look things up while you write, hold what it finds, and stay quiet the rest of the time.

I post-trained Qwen3 30B-A3B into a text interaction model. It follows typing as a timestamped stream and chooses one action at each step: stay idle, mark a span, delegate a lookup, integrate a pending result, skip stale information, or respond. Most of the time, it stays quiet. The project started with a practical question about Thinking Machines' interaction models: what would the same idea look like in text, where the model sees partial drafts but should rarely intervene? The resulting model can mark relevant words, look up information while a sentence is still being written, hold onto…

saved by

related reading