SIGN IN SIGN UP

Implement the OLMo architecture (#6741)

* implement olmo architecture

* remove unused variable

* remove unused moe branch

* remove check for weight

* remove superfluous moe, bias and rope tensors

* clarified comment

* fix clamp_kqv setting

* remove obsolete parameter name filter
N
nopperl committed
9958c81b798a5872087b30b360e4674871f2479e
Parent: 8b1b1f4
Committed by GitHub <noreply@github.com> on 4/19/2024, 9:35:54 AM