Implement the OLMo architecture (#6741)
* implement olmo architecture * remove unused variable * remove unused moe branch * remove check for weight * remove superfluous moe, bias and rope tensors * clarified comment * fix clamp_kqv setting * remove obsolete parameter name filter
N
nopperl committed
9958c81b798a5872087b30b360e4674871f2479e
Parent: 8b1b1f4
Committed by GitHub <noreply@github.com>
on 4/19/2024, 9:35:54 AM