old model: rwkv7 | Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on lemmy.ml

localllama·LocalLLaMAbyleanleft

old model: rwkv7

RWKV-7 is an attention-free recurrent architecture with a constant-size recurrent state and constant inference work per generated token.

https://huggingface.co/collections/RWKV/rwkv-v7

https://www.rwkv.com/

https://huggingface.co/papers/2503.14456

https://arxiv.org/abs/2503.14456

https://blinkdl-rwkv-gradio-1.hf.space/

View original on lemmy.ml

2

No replies yet

No comments on the original post yet.

old model: rwkv7 | Spyke