Row-parallel linear layer mathematical notation

Row-parallel linear layer is a recurring research-paper notation family. Partitions a linear layer's input dimension so each rank computes a partial output that must be summed across ranks.

Row-parallel linear layer: Partitions a linear layer's input dimension so each rank computes a partial output that must be summed across ranks. Example: Every rank contributes part of each output activation and the collective adds them.