Floating point from scratch: Hard Mode · Tales on the wire
essenceia.github.io · 9,771 words · saved by 1 readers
Actually building floating point from scratch!
Table of Contents Table of Contents I have a confession to make: floating point scares me. Half a decade ago I decided that I was going to implement some floating point arithmetic. Back then it seemed approachable enough, after all, floating points are ubiquitous. How hard can it really be ? My experience until that point had been: given enough time and effort is spent bashing my brain against a problem, I can generally figure things out. This is how I faced the most complete technical defeat of my existence. Through this utter annihilation emerged my present fear of floating point. After half
saved by
related reading
- Ken Shirriff's blogrighto.com
- There are Only Four Billion Floats-So Test Them All! | Random ASCII – tech blog of Bruce Dawsonrandomascii.wordpress.com
- 1. Introduction — Floating Point and IEEE 754 13.3 documentationdocs.nvidia.com
- Adding Floating-Point Decimals for Fun and Profitblog.vero.site
- Half-precision floating-point format - Wikipediaen.wikipedia.org
- All About Rooflines | How To Scale Your Modeljax-ml.github.io
- Schanuel’s conjecture and the semantics of FPSan | Complex Projective 4-Spacecp4space.hatsya.com
- 練習 - 探索浮點類型 - Training | Microsoft Learnlearn.microsoft.com
- githublog/2024/5/29/fast-inverse-sqrt.md at main · francisrstokes/githublog · GitHubgithub.com
- What’s MXFP4? The 4-Bit Secret Powering OpenAI’s GPT‑OSS Models on Modest Hardwarehuggingface.co
- William Kahanen.wikipedia.org
- Defeating the Training-Inference Mismatch via FP16arxiv.org