Vector compression
Storing millions of 4096-dimension float32 vectors gets expensive fast, so production systems shrink them: fewer dimensions, smaller number formats, or coarser codes. Compression trades a little recall for a lot of memory and speed — the art is knowing how much accuracy your product can give away.