Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on fedia.io
localllama·LocalLLaMAbytroed

My llama-server suddenly started error 400 on the chat template - this fixed it

I regularly recompile llama.cpp but after having done so today my existing setup stopped working. llama-server started throwing an error 400 on the chat template in the Ornith 1.0 35B model I'm mostly using.

Couldn't find anything (except a closed stale issue on llama.cpp that seemed slightly similar) so I followed the advice from another posted there and installed the linked "fixed" Qwen chat templates.

That worked, so, just posting this here in case it might help someone else too.

My llama-server suddenly started error 400 on the chat template - this fixed ithttps://huggingface.co/froggeric/Qwen-Fixed-Chat-TemplatesOpen linkView original on fedia.io
6

No replies yet

No comments on the original post yet.
My llama-server suddenly started error 400 on the chat template - this fixed it | Spyke