Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on reddthat.com
localllama·LocalLLaMAbye0qdk

meta-models/Muse-Glimmer-30B-GGUF

Meta released a ~30B parameter open weight dense model today called Muse Glimmer.

The main link I submitted goes to their official GGUF release for 24GB and 32GB discrete GPUs.

If you want the full sized safetensors, they're here: https://huggingface.co/meta-models/Muse-Glimmer-30B

Also, Meta's announcement post is here: https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model

Since the model is dense it's slow on Strix Halo (~2 tok/s) but I'm getting usable speeds on a discrete GPU (~25 tok/s on my hardware with the official GGUFs).

If you get complaints about unsupported model type in llama.cpp pull the latest code from git and rebuild from source. I've got it working with version: 10355 (dd1ea5243) and I'm testing it out now.

Edit: with the drafter, I'm usually getting more like 30~40 tok/s.

meta-models/Muse-Glimmer-30B-GGUFhttps://huggingface.co/meta-models/Muse-Glimmer-30B-GGUFOpen linkView original on reddthat.com
25

3 replies

Going to try this out too, context is listed at 128k so curious if it really compares to Qwen3.6-27B

5

Glad to see more competition for this model size. I don’t like how terse it is, but the code quality doesn’t seem to far off from Qwen 3.6.

1

You reached the end

meta-models/Muse-Glimmer-30B-GGUF | Spyke