KV-cache utilization mathematical notation

KV-cache utilization is a recurring research-paper notation family. Compares bytes holding active key-value entries with bytes reserved by the serving allocator.

KV-cache utilization: Compares bytes holding active key-value entries with bytes reserved by the serving allocator. Example: Measure how much allocated cache actually stores live tokens.