Communication volume mathematical notation

Communication volume is a recurring research-paper notation family. Counts bytes transferred between devices by a distributed operation, separately from arithmetic work and local memory traffic.

Communication volume: Counts bytes transferred between devices by a distributed operation, separately from arithmetic work and local memory traffic. Example: Convert the communicated tensor size into bytes on the wire.