Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Add `rank_zero_first` utility (#17784)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
A
Adrian Wälchli committed
9ff7d7120b87def139ca67671109366921f4c683
Parent: e4a3be7
Committed by GitHub <[email protected]>
on 6/12/2023, 10:32:32 AM