Autoregressive decode phase mathematical notation
Autoregressive decode phase is a recurring research-paper notation family. Generates output tokens sequentially while reading prior key-value cache entries and appending one new entry per layer.
Autoregressive decode phase: Generates output tokens sequentially while reading prior key-value cache entries and appending one new entry per layer. Example: Approximate completion time from the number of iterative decode steps.