Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Make DDP subprocess the default launcher for multi-device (#16780)
A
Adrian Wälchli committed
81b7c30291ef08b4b150d993efa853738bedb3d5
Parent: 3a05191
Committed by GitHub <[email protected]>
on 2/20/2023, 11:20:50 AM