Lightning-AI / pytorch-lightning UNCLAIMED

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

0 0 0 Python

(4/n) Support 2D Parallelism - Loading optimizer states correctly (#19872)

* Load optimizer state

* move to utility

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

awaelchli committed 1y ago

1d0c6aae9634da61bbf58262fd85edd08438c6cc

Parent: cd8acc2

Committed by GitHub <[email protected]> on 5/17/2024, 9:17:32 PM