Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
COMMITS
/ tests/benchmarks/test_sync_batchnorm_parity.py February 26, 2022
A
add parity test for sync batchnorm (#12021)
Adrian Wälchli committed