Papers & systems
The papers that define modern LLM inference, in reading order: from tiling the attention score matrix to compressing the KV cache away.
The papers that define modern LLM inference, in reading order: from tiling the attention score matrix to compressing the KV cache away.