BF16, FP8, INT8 & 4-Bit Inference

The ladder in the previous lesson carried four names without opening any of them. Two formats can occupy the same byte and still disagree about which numbers they are able to hold, so a width is not quite the single quantity the ladder treated it as. This lesson opens the four the module is built on, then weighs a published…

In this lesson

• How a format spends its bits
• The two FP8 encodings
• INT8, four bits, and the scale
• Reading the notation
• The weight of a published four-bit build

Continue learning

Pro unlocks the complete lesson, video, practice, and code where available.