RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Import incomplete
This repository was imported from GitHub but the migration didn't fully complete. You can retry the import to fix it.
Quick setup
Get started by creating a new file or uploading an existing file. We recommend every repository include a README, LICENSE, and .gitignore.
https://gitmorph.com/BlinkDL/RWKV-LM.git CREATE A NEW REPOSITORY ON THE COMMAND LINE
touch README.md git init git checkout -b main git add README.md git commit -m "first commit" git remote add origin https://gitmorph.com/BlinkDL/RWKV-LM.git git push -u origin main
PUSH AN EXISTING REPOSITORY
git remote add origin https://gitmorph.com/BlinkDL/RWKV-LM.git
git push -u origin main