Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Fix comm initialization in `MPIEnvironment` (#19074)
A
Adrian Wälchli committed
197b22586a449fd24d6835c2b186d7900de05c93
Parent: 9d36604
Committed by GitHub <noreply@github.com>
on 11/28/2023, 9:14:46 PM