Point-to-point communication mathematical notation

Point-to-point communication is a recurring research-paper notation family. Transfers a tensor directly between a specified source rank and destination rank rather than involving every rank collectively.

Point-to-point communication: Transfers a tensor directly between a specified source rank and destination rank rather than involving every rank collectively. Example: Move one pipeline activation to the next stage.