Yeah I tried Kat Coder when it came out, I don't remember the exact issue I ran into but I identified a definite regression in my specific use cases compared to using vanilla. Ornith seems to be equivalent or better so far 👍

You might want to try running Ling-3.0-Flash (124B-A5.1B) it might be perfect for your M4 and should perform close to the level of DeepSeek V4 Flash preview or MiniMax M2.7

My previous experience with finetunes is bad..

Today I tried Ornith-1.5-35B-A3B, and I'm quite positively surprised by it.. I compared it to both Qwen3.7-Flash and MiMo-V2.5 (via OpenRouter) in a few coding tasks and Ornith seems to be better than both! Thinks much more but the result definitely speaks for itself.

Hoping for Qwen3.8-35B soon 🤞

I'll add my vote to keeping the 32+8 system as that has the most ram.

I also have an 8GB RTX 3070 Ti and 32GB RAM that I run Qwen3.6-35B-A3B perfectly on (30+ t/s) and looking forward to a possible Qwen3.8 35B update.

Recently bought a used 8GB RTX 3070 for a bargain, planning to combine it with the 3070 Ti and hopefully run a lower quant Qwen3.8-27B which is crazy good for its size.

Older models may not know how to tool call which is required for read/write access, in general stay with models released this year.

Qwen3.6-35B-A3B works well for 24GB RAM + 8GB VRAM (I run it on 32+8 via llama.cpp).

Regarding permissions, opencode should have default write permissions by default to current folder and will ask for permission for read/write to external folders (such as /tmp) only when needed.

A quick test to make sure opencode is working fine, first make sure you're in Build mode by pressing TAB until you see Build. Then prompt:

Write today's date/time to `today.md`

if it fails to run date then writing today.md correctly in current directory, then the model is most likely not able to do tool calling.

Totally agree, I've been in the situation where a remote host is 100%-ing and when I want to ssh into it to figure out why and possibly fix it, I can't cause ssh is unresponsive! leaving only one way out of this, hard reboot and hope I didn't lose data.

This is a fundamental issue in Linux, it needs a scheduler from this century.

Minecraft with factory modkit for me

Cheers for the new local GOAT!

Also on ModelScope in case you-know-who bribes huggingface takedown because model is too dangerous.

free to use if you have the hardware. For this model because of its size, the main problem is the hardware availability/cost. But in general there are 3 ways to run an open weights model:

• pay a provider like DeepSeek/OpenRouter per usage
• buy hardware that can run it locally: actually not a bad investment for a business
• rent hardware that can run it from a cloud provider, hardware can be rented dedicated or time-shared (so called serverless).

Everything runs well if one is patient enough 😂

But yeah, with a smaller context and carefully offloading some of the layers to the CPU, it'll run just not very fast. And definitely using Q4 quants.

No you don't need a data center, this can run on any current gaming PC with a GPU that has 16GB+ VRAM.

Although to get good token generation speed and full context you need at least 24GB VRAM.

I like reading about OS journeys like these. Personally I ended up living with immutable fedora despite of its endless challenges, but I don't think I'll ever go back to mutable linux for my dev laptop. I feel immutability is a shield against change over time.

As a dev, the divide between apps users and computer software users is fascinating. My mom can do things in instagram or whatsapp that I didn't even know possible.. but put her in front of a modern computer with a simple application and she's completely lost! I try to explain that it's exactly the same as her phone its just a larger screen/physical keybaord with different apps, doesn't seem to help.

I only have 8gb vram and can run 35b-a3b perfectly (30+ tps), have you tried 35b?

Appears they removed the branch and changesets

I hope their decision to opensource Qwen3.8-Max means this version is going to be another open-weights frontier contender 👍

Stop comparing tools

• Hammer is heavy
• Wrench is elegant
• Saw is versatile
• Screwdriver
• Drill is exciting

such pointless

Wow, got about 9 repos of mine there and a few from my startup's, only public ones are scraped so I say fair enough. Happy to have switched to running my own git infra a year ago

Chinese open weights models are no longer niche. I think opencode were betting on the niche angle and over-subscribing far above their capacity to serve hoping most users don't saturate their quotas. But this is no longer the case thanks especially to the new deepseek v4 flash which kinda broke the economy of API resellers.

Personally, I can understand the economic complexity combined with the huge surge in demand. What I don't understand is why be vague about serving capacity and pricing while continuously tweaking usage quotas significantly without any notification to their subscribers.