Making large AI models cheaper, faster and more accessible
[shardformer] Support customized policy for llamav2 based model with HybridParallelPlugin (#4624)
* Enable policy assignment in HybridPlugin and enable llama policy for llamav2 * Remove Policy from Plugin * revert changes of plugin HybridParallelModule * revert changes in plugin * upgrade transformers * revert transformers version --------- Co-authored-by: flybird11111 <1829166702@qq.com>
E
eric8607242 committed
c3d5fa3bac85baa07e30e2978a7517034ba7e0aa
Parent: 9709b8f
Committed by GitHub <noreply@github.com>
on 9/7/2023, 2:15:13 AM