Yeah Ornith 1 35b seemed pretty good when I tried it, haven't tried 1.5 yet. The only one from the 1.5 series I tested so far was 9b and it seems to punch above its weight

Yeah that one was over a torrent site, I think nyaa.si

https://lemmy.ca/post/69262372

https://www.techspot.com/news/113446-years-long-investigation-unmasked-major-torrent-pirate-how.html

another one to try https://huggingface.co/peculiar-ragdoll/Tiel-Coder-35B-A3B-GGUF

https://lemmus.org/post/24873652

Have you tried Kat Coder? It's also a fine-tune of Qwen 35b and I've heard good things about it

8GB VRAM RTX 3070 + 32 GB DDR5 + 1TB NVMe SSD - AMD Ryzen 5 7600X CPU - putting this here in case it’s substantially better than the BC-250

Yes this can run Qwen 3.6 35b-a3b pretty nicely! And they might be releasing an updated version of that soon. Your BC-250 only has 16GB total which is not enough for 35b.

I also have 32GB RAM and 8GB VRAM, my computer is a little slower than yours, see my guide: https://lemmus.org/post/24235317

For the BC-250 you might try smaller models like Ling 3.0 Tiny, Ornith 1.5 9b, or Gemma 4 12b QAT

For your 8GB RAM devices, you can run Gemma 4 e4b QAT, Qwen 3.5 4b, or maybe Ling 3.0 Tiny

I’m a noob to local LLMs.

Use Unsloth Desktop or llama.cpp. Then you can connect Zoo Code to it, that's a VSCode extension which I like for programming with my local LLMs.

They don't tell us things lol. All they said was

Which sounds like there's something "better" coming, but doesn't deny the possibility of 35b-a3b. Which is weird because "better" is subjective and depends on your hardware. It could be smaller and smarter than 3.6 35b, but then people are gonna ask for a 3.8 35b because it should be even smarter.

They have a graph, differences are tiny at that high end

I feel like Ornith 1.0 9b was the best coding model at that size (since Qwen has neglected that size). Maybe now Ling Tiny is better but I'm curious to try Ornith 1.5

There are other ways investigators could have connected activity to Ono. He may have used Nyaa without a VPN while logged into an account. Data from website cookies or content-delivery-network logs could also have been matched with Nyaa activity and tracker records. CODA has not said whether any of those methods were used.

VPN isn't enough, you gotta worry about fingerprinting and cookies too. Recently it was revealed that Windows 11 has strong fingerprinting options that could be used to track you.

I wonder if they were using a VPN or seedbox. You could even do remote desktop into seedbox and browse the sites from there.

Old music doesn't get re-recorded for digital releases, they pull it from the original master again, which is better and more authentic than vinyl.

I mean if you went to a concert would you want them to add hiss and pop to the performance so it sounds more like vinyl? Lol certainly you wouldn't want them to intentionally worsen the signal-to-noise ratio

https://huggingface.co/unsloth/Qwen3.8-2.4T-A95B-GGUF

just hoping for a new 35b a3b

anyone try this? this might be good for my crappy laptop lol

is it good enough to use with Zoo Code? is it better than Qwen 3.5 4b?

EDIT: woa

https://artificialanalysis.ai/models/ling-3-0-tiny

But not yet supported in llama.cpp https://github.com/ggml-org/llama.cpp/pull/26608

the original model has a lot of parts that were natively trained in 4 bit, so those layers can't go higher

You're looking for "2160p remux" torrents

Have you tried preserve thinking? https://lemmus.org/post/24365786

That's a really cool idea. It's like inception for an LLM, you make it think it was the one that thought of this lol

--n-cpu-moe 36 --spec-type draft-mtp --spec-draft-n-max 3 does seem to speed up token generation for me

Can't use llama-bench for MTP. In a basic tests it seems to improve from about 26 to 30 tokens per second output. But it seems to hurt my input speed from about 1300 pp down to 800.

make sure that holds up with large context, you might need to step down to Q3 (which I've heard is still good for this model, many people are even using IQ2)

I've run Qwen 3.5 4b and Gemma 4 e2b on CPU only, this should be faster than those I think (fewer active parameters). If you have AVX512 or AVX10 then it should help a bit. Still slow compared to a GPU lol.

true, it's not perfectly clear

also I just saw this