Spyke

7 replies

programming.dev

My previous experience with finetunes is bad..

Today I tried Ornith-1.5-35B-A3B, and I'm quite positively surprised by it.. I compared it to both Qwen3.7-Flash and MiMo-V2.5 (via OpenRouter) in a few coding tasks and Ornith seems to be better than both! Thinks much more but the result definitely speaks for itself.

Hoping for Qwen3.8-35B soon 🤞

1
lemmus.org

Have you tried Kat Coder? It's also a fine-tune of Qwen 35b and I've heard good things about it

1
SirDimplesreply
programming.dev

Yeah I tried Kat Coder when it came out, I don't remember the exact issue I ran into but I identified a definite regression in my specific use cases compared to using vanilla. Ornith seems to be equivalent or better so far 👍

2

Yeah Ornith 1 35b seemed pretty good when I tried it, haven't tried 1.5 yet. The only one from the 1.5 series I tested so far was 9b and it seems to punch above its weight

2
lemmus.org

I feel like Ornith 1.0 9b was the best coding model at that size (since Qwen has neglected that size). Maybe now Ling Tiny is better but I'm curious to try Ornith 1.5

2

I agree. I'm very interested to try it. I felt like Ornith 1.0 tried a little too hard to second-guess and overcorrect itself and would sometimes end up steering itself down an inescapable rabbit hole of self-correction ad absurdum, when ironically its first solution was often the best, sometimes would work as-is or with only a little refinement needed. I'm hopeful that 1.5 will improve that.

1

You reached the end