Parameter memory mathematical notation

Parameter memory is a recurring research-paper notation family. Estimates raw storage occupied by model parameters from parameter count and bytes stored per parameter.

Parameter memory: Estimates raw storage occupied by model parameters from parameter count and bytes stored per parameter. Example: A seven-billion-parameter FP16 model needs roughly fourteen billion raw bytes.