Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Fixes around `Strategy.set_world_ranks` (#16966)
* don't call set_world_ranks in xla strategy * update * fabric and other strategies * CHANGELOG * Typos * Reuse test --------- Co-authored-by: Carlos Mocholí <[email protected]>
A
Adrian Wälchli committed
50662eb0781fdb7184f5958736847955558874b0
Parent: 17548d5
Committed by GitHub <[email protected]>
on 4/13/2023, 3:45:42 PM