Aitrepreneur: NEW ExLLAMA Breakthrough! 8K TOKENS! LESS VRAM & SPEED BOOST!

Syndicated from the fediverse. Read and engage on the original instance.

oobabooga·Oobabooga Text Generationby2dollarsim

Tested it myself, huge improvement!

No replies yet

No comments on the original post yet.

Aitrepreneur: NEW ExLLAMA Breakthrough! 8K TOKENS! LESS VRAM & SPEED BOOST! | Spyke