Baize exLlama SuperHOT is the best model I've used yet

Syndicated from the fediverse. Read and engage on the original instance.

oobabooga·Oobabooga Text Generationby2dollarsim

This has been the best so far, some wierd behaviour sometimes, maybe that's my parameters though.

For some characters, this has been the best at keeping them in character and progressing the story!

3 replies

so glad to find this sub on lemmy. i was trying to find out more about this and didn't want to re-open my reddit! thank you for posting

Edit: unusably slow when i first got it set up but much faster once I got the GPTQ-for-llama set up. Some really good responses.

I ended up downloading all of the 13B SuperHOT models, each one seems great, but I am still trying to work out how to set the parameters correctly