Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
[HotFix] Resolve TPU Training (#6027)
* fix tpus * update * add back reduction in val_loss * resolve some bugs with TPUs * update changelog * update on comments * forgot status * Fix train_bn arg * resolve comments * update on comments Co-authored-by: Carlos Mocholi <[email protected]>
C
chaton committed
6bc4490d01aed21c2d52f884d4afbeaa24a47ca0
Parent: 5700fd0
Committed by GitHub <[email protected]>
on 2/17/2021, 4:40:13 PM