Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Make manual optimization mandatory for multiple optimizers (#16539)
Co-authored-by: Carlos Mocholí <[email protected]>
A
Adrian Wälchli committed
6a5658649208f6e0caa214326389d6f1e7cc02f4
Parent: df09370
Committed by GitHub <[email protected]>
on 2/1/2023, 4:21:01 PM