✳flâneur — a map of the web's best reading
What’s MXFP4? The 4-Bit Secret Powering OpenAI’s GPT‑OSS Models on Modest Hardware
huggingface.co · 944 words · saved by 1 readers
A Blog post by Rakshit Aralimatti on Hugging Face
What’s MXFP4? The 4-Bit Secret Powering OpenAI’s GPT‑OSS Models on Modest Hardware Back to Articles a]:hidden"> What’s MXFP4? The 4-Bit Secret Powering OpenAI’s GPT‑OSS Models on Modest Hardware Community Article Published August 8, 2025 Upvote 36 +30 Rakshit Aralimatti RakshitAralimatti Follow With native MXFP4 precision, GPT‑OSS‑120B runs on a single H100 GPU and GPT‑OSS‑20B fits within just 16 GB of memory. What is MXFP4? The Definition and Its Origin Story MXFP4 stands for Microscaling FP4, a next-generation 4-bit floating-point format created and standardized in early 2024 by the Open Com
Explore this link on the map →saved by
related reading
- GPT-4openai.com
- gpt-4.pdfcdn.openai.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4. · GitHubgithub.com
- My picture of the present in AI — LessWronglesswrong.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- MatX: High-throughput chips for LLMsmatx.com
- A Picture is Worth 170 Tokens: How Does GPT-4o Encode Images?oranlooney.com
- microgptkarpathy.github.io
- Learning to reason with LLMs | OpenAIopenai.com
- 1.5x faster MoE training with custom MXFP8 kernels · Cursorcursor.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Mamba: The Easy Wayjackcook.com