Pipeline bubble mathematical notation
Pipeline bubble is a recurring research-paper notation family. Represents device idle time while a model pipeline fills, drains, or waits for imbalanced neighboring stages.
Pipeline bubble: Represents device idle time while a model pipeline fills, drains, or waits for imbalanced neighboring stages. Example: More microbatches amortize pipeline fill and drain overhead in an ideal schedule.