Making large AI models cheaper, faster and more accessible
[checkpointio] support unsharded checkpointIO for hybrid parallel (#4774)
* support unsharded saving/loading for model * support optimizer unsharded saving * update doc * support unsharded loading for optimizer * small fix
B
Baizhou Zhang committed
64a08b2dc360de46229af16022eeadae12b2ff35
Parent: a2db755
Committed by GitHub <noreply@github.com>
on 9/26/2023, 2:58:03 AM