NCCL Source Code Study

14 - NVLink SHARP

13 - IB SHARP

12 - Double Binary Tree

11 - Ring Allreduce

10 - Inter-machine ncclSend and ncclRecv Process

9 - Single-machine ncclSend and ncclRecv Process

8 - Establishment of Data Communication Link Transport

7 - Inter-machine Channel Connection

6 - Channel Search

5 - Path Calculation

4 - Graph Building Process

3 - Intra-machine Topology Analysis

2 - Establishment of Bootstrap Network Connection

1 - Initialization and Generation of ncclUniqueId