Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on piefed.social
localllama·LocalLLaMAbyXiELEd

<8B multilingual models for language learning chatbots

I am currently looking for a model that can run on my phone, it could be <8b or even <4b. It should have a reduced positivity/yes-man bias. I am at a point in my language learning journey where it's more effective to learn a language through trying to actually construct a sentence (which is often through interaction) instead of just reading. Since there are times I am offline, a local LLM that is competent at multiple languages and decent at simulating characters texting would be a great help.

View original on piefed.social
9

3 replies

XiELEdreply
piefed.social

Thanks! I can't wait to try them. Though what differences do you find between Granite-4H and Qwen3-4B 2507?

1

ministral3-3b at crappy quants is better than internet search (faster). terrible for agentic stuff, but low thought tasks that you want to get though fast, this is perfect

1

You reached the end

<8B multilingual models for language learning chatbots | Spyke