Rhackernews·Hacker NewsbyRSS Bot There is minimal downside to switching to open modelsCommentshttps://www.marble.onl/posts/cancel_claude.htmlOpen linkView original on lemmy.bestiver.se18Comments1
eejs piefed.social… if you have the ram (with fast enough bandwidth) MoE models are pretty magic on my laptops 32gb ram. 24 tok/sec on DDR5-5600 using Gemma 4 26B-A4B is so much faster than a dense model3
… if you have the ram (with fast enough bandwidth)
MoE models are pretty magic on my laptops 32gb ram. 24 tok/sec on DDR5-5600 using Gemma 4 26B-A4B is so much faster than a dense model