Making large AI models cheaper, faster and more accessible
[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)
* fix master param sync for hybrid plugin * rewrite unwrap for ddp/fsdp * rewrite unwrap for zero/gemini * rewrite unwrap for hybrid plugin * fix geemini unwrap * fix bugs
B
Baizhou Zhang committed
c0a033700c7027286ecd8a7bcbaafc6f794323ad
Parent: 7b9b864
Committed by GitHub <noreply@github.com>
on 9/20/2023, 10:29:37 AM