Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Remove the requirement for FSDPStrategy subclasses to only support GPU (#19894)
A
awaelchli committed
8fc7b4ae945c6d0204976ff3c45d5b546b7a475a
Parent: 987c2c4
Committed by GitHub <[email protected]>
on 5/22/2024, 4:31:40 PM