Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Support true 16-bit precision with FSDP in Trainer (#18219)
A
Adrian Wälchli committed
888466b1445233d162fade85e02a4b02b513f609
Parent: 70e31b6
Committed by GitHub <[email protected]>
on 8/10/2023, 8:15:35 AM