Training LLMs to Predict World Events (Guest Post with Mantic) - Thinking Machines Lab
Mantic have been using Tinker since it launched. This guest post is a technical deep dive on what they have built so far. The top AI forecasting systems are approaching superforecaster-level accuracy on geopolitics and current affairs.It’s over (Polymarket, 2026) This is exciting because scalable, automated forecasting could significantly improve the quality of decision-making across the economy and in government. To date, the most successful recipe in forecasting tournaments has been to combine an off-the-shelf LLM (like Gemini 3 or GPT-5) with forecasting-specific context-gathering. These models, to our knowledge, have not been explicitly trained for forecasting. Can we improve the recipe by replacing them with models fine-tuned specifically for forecasting?
Mantic have been using Tinker since it launched. This guest post is a technical deep dive on what they have built so far. The top AI forecasting systems are approaching superforecaster-level accuracy on geopolitics and current affairs. It’s over (Polymarket, 2026) This is exciting because scalable, automated forecasting could significantly improve the quality of decision-making across the economy and in government. To date, the most successful recipe in forecasting tournaments has been to combine an off-the-shelf LLM (like Gemini 3 or GPT-5) with forecasting-specific context-gathering. These m
Explore this link on the map →saved by
related reading
- DeepSeek-R1arxiv.org
- Pitfalls in Evaluating Language Model Forecastersarxiv.org
- 🔮 IT’S OVER - The Oracle by Polymarketnews.polymarket.com
- gpt-4.pdfcdn.openai.com
- AI in 2025: gestalt — LessWronglesswrong.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Modifying LLM Beliefs with Synthetic Document Finetuningalignment.anthropic.com
- Is Capability a Liability? More Capable Language Models Make Worse Forecasts When It Matters Mostarxiv.org
- Recursive forecasting: Eliciting long-term forecasts from myopic fitness-seekers — AI Alignment Forumalignmentforum.org
- The AI Superforecasters Are Here - by Scott Alexanderastralcodexten.com
- Teaching LLMs to reason like Bayesiansresearch.google
- What 2026 looks like — AI Alignment Forumalignmentforum.org