Switch collectives from MPI/UCX to NCCL/RCCL (torchdist)#5

AVSuni wants to merge 10 commits into

tensorwavecloud:maintensorwavecloud/ScalarLM:mainfrom

AVSuni:switch-to-rcclAVSuni/ScalarLM:switch-to-rcclCopy head branch name to clipboard