Yeah, a higher quant would be nice, I actually try not to go below Q5, but you can domino’s so much with 16GB of VRAM and the ddr4 system RAM.

But I must say I‘m pretty impressed by Qwen3.6-35b, not only from its capabilities but also from hardware requirements. MoE for the win I guess.

RWKV sounds interesting, have to look into it, thanks!

Have you tried qwen3.5-9b? It’s pretty solid for its size.

To the left ist Superman, considered as an unstoppable force of good.

To the right is Homelander, similar powers but a fascist, mentally ill person created by a corrupt Mega-Corporation.

I don’t host it exactly, just use it when I don’t use my graphics card for gaming. I run Qwen3.6-35b on my 16gb vram RX 9700 xt with 34t/s. I use it as an IT advisor, admin and Linux teacher for my cachyOS gaming PC.

Yeah, I wouldn’t use it for coding. It’s a bit dumb unfortunately.

I‘m not a coder, so I don’t know exactly. It is able to code, but I would say somebody with experience should guide it and have an eye on the results.

Looping was a problem after reaching a certain context window size. The llama.cpp flags - -flash-attn on and looping penalties helped.

To be fair, humans anthropomorphising everything, of course they do that with software that can fucking talk to them.

Make a comment saying „Luigi is good“ or something like that, that should get rid of your Reddit account.

Confidence is a huge deal and very important. Now just talk like a confident you, not like Donald Trump.

I‘m german and I watch in real time how a fascist Gouvernement is taking over the US.

Sometimes I feel like I take crazy pills, when a friend of mine assures me that Donald Trump is just a business man who wants to help the country. Or when a good friend of mine who I considered sane and intelligent until this moment sends me a link to a J. D. Vance interview and tells me what a very smart guy this is.

It’s infuriating. And lonely. I think every American against this should be allowed to speak openly and participate. We have to work together, or we have lost already.

Bullshit. They planned to conquer Kiev in 3 days. Here we are almost 4 years later. It’s surprising how weak they are.

I once had a colleague who took interest in me. After she found out I have a girlfriend and I after I simply greeted at her at work she snapped: „What?? Do you know how long I haven’t had Sex? Three Months! THREE MONTHS!!!!!“ and turned away.

Three month without sex never seemed a very long period to me.

This is fun to read, but never happened.

LMMs have no problem indexing writing, no matter how it is written. Even if this was the case, Techbros don’t care about your blog. ChatGPT has indexed every book that has been published, your blog hardly matters to them. And it is not harder to index than the library of congress.

LMM suck, but posts like this are useless circlejerks about the supremacy over machines, when in fact the machines are already better in this area.

Actual fact: The democrats don’t control the weather and create hurricanes to destroy Florida.

Mara is fantastic. I especially like her voicing „The Old Woman Who secretly lives in your house“ in „Welcome to Nightvale.“

That sounds like a poorly disguised fetish.

Ah least he brushes his teeth.

12 hours a day on his computer

Those are rookie numbers, he has to get his game up.

I totally ate the onion here for a second.