Making large AI models cheaper, faster and more accessible
[shardformer] support pp+tp+zero1 tests (#4531)
* [shardformer] fix opt test hanging * fix * test * test * test * fix test * fix test * remove print * add fix * [shardformer] pp+tp+zero1 [shardformer] pp+tp+zero1 [shardformer] pp+tp+zero1 [shardformer] pp+tp+zero1 [shardformer] pp+tp+zero1 [shardformer] pp+tp+zero1 * [shardformer] pp+tp+zero1 * [shardformer] pp+tp+zero1 * [shardformer] pp+tp+zero1 * [shardformer] pp+tp+zero1
F
flybird11111 committed
ec18fc7340f99693f2436e91e1dea99342f476d5
Parent: d367b88
Committed by GitHub <noreply@github.com>
on 8/30/2023, 1:29:18 PM