flâneur

Teaching GPT-5 to Use a Computer

blog.sdan.net · 1,686 words · saved by 1 readers

Over the weekend, I won #3 at OpenAI’s GPT-5 Hackathon1 with Archon — a copilot for your computer. It pairs a mini vision model for speed with GPT-52 for variable reasoning to plan. Here’s how it works, the inference math behind it, and the tradeoffs I made. Archon is a small bar that sits at the bottom of your Mac/Windows screen where you can type what you want your computer to do in natural lan

Over the weekend, I won #3 at OpenAI’s GPT-5 Hackathon1 with Archon — a copilot for your computer. It pairs a mini vision model for speed with GPT-52 for variable reasoning to plan. Here’s how it works, the inference math behind it, and the tradeoffs I made. Archon is a small bar that sits at the bottom of your Mac/Windows screen where you can type what you want your computer to do in natural language. It takes screenshots to see what’s on screen, uses GPT-5’s reasoning to plan, then a custom fine-tuned model executes clicks and keystrokes. In a racing game demo with a single instruction to…

related reading