Half-precision floating-point format
Half precision (sometimes called FP16 or float16) is a binary floating-point computer number format that occupies 16 bits (two bytes in modern computers) in computer memory. It is intended for storage of floating-point values in applications where higher precision is not essential, in particular image processing and neural networks.
Half-precision floating-point format - Wikipedia Jump to content From Wikipedia, the free encyclopedia 16-bit computer number format Not to be confused with bfloat16 , a different 16-bit floating-point format. Half precision (sometimes called FP16 or float16 ) is a binary floating-point computer number format that occupies 16 bits (two bytes in modern computers) in computer memory . It is intended for storage of floating-point values in applications where higher precision is not essential, in particular image processing and neural networks . Almost all modern uses follow the IEEE 754-2008 stan
saved by
related reading
- Floating point operations per second - Wikipediaen.wikipedia.org
- Floating point from scratch: Hard Mode · Tales on the wireessenceia.github.io
- What’s MXFP4? The 4-Bit Secret Powering OpenAI’s GPT‑OSS Models on Modest Hardwarehuggingface.co
- Quantization · Hugging Facehuggingface.co
- All About Rooflines | How To Scale Your Modeljax-ml.github.io
- 1. Introduction — Floating Point and IEEE 754 13.3 documentationdocs.nvidia.com
- Defeating the Training-Inference Mismatch via FP16arxiv.org
- Ken Shirriff's blogrighto.com
- Adding Floating-Point Decimals for Fun and Profitblog.vero.site
- 練習 - 探索浮點類型 - Training | Microsoft Learnlearn.microsoft.com
- Quantization from the ground upngrok.com
- The 4-bitter Lesson | humans&humansand.ai