Why is FlashAttention faster? Fanout ProContinue readingThis source-rich field note is available with Fanout Pro.Get Fanout ProRelated articlesFlashAttention vs PagedAttention: what each fixesFP8 attention vs FP8 KV cacheHybrid KV cache vs recurrent state memoryContinue learningInference Memory and KV CacheInference engineering