What's this 🤣 https://huggingface.co/richardyoung/Bev-9B-inverted

No, you can run sd, flux based model inside the koboldcpp. You can try it out using the original koboldcpp in google colab. It loads gguf model. Related discussion on Reddit: https://www.reddit.com/r/StableDiffusion/comments/1gsdygl/koboldcpp_now_supports_generating_images_locally/

Edit: Sorry, I kinda missed the point, maybe I'm sleepy when writing that comment. Yeah, I agree that LLM need big memory to run which is one of it's downside. I remember someone doing comparison that API with token based pricing is cheaper that to run it locally. But, running image generation locally is cheaper than API with step+megapixel pricing.

They got the whole Twitter database. It's kinda the same with Gemini. But somehow Meta isn't catching up, maybe their llama 4 architecture isn't that stable to train.

There is koboldcp-rocm fork. Koboldcpp itself has basic image generation. https://github.com/YellowRoseCx/koboldcpp-rocm

Lots of developer choose to write in CUDA as ROCm support back then is a mess.

Llama.cpp themself is slow, lot of model lose their popularity.

Everybody been rumoring about R2. So releasing this thing kinda unexpected

I usually use skill like openspec when requesting LLM to do something, combining them with matt's skills like grill-me. I assume both of this skill will make LLM output in certain way as I jump between model, I don't really notice them. Usually I also ask to 'talk in basic english language' or ' talk in simplified technical english language' when just asking random things in the codebase. Surely not perfect and better to have normal sounding LLM directly.

Ternary quant from prism-ml is not that good for complex task and long context. Probably fixable by using higher bit on certain tensor. As far I know for real world usage, at least non uniform 3 bit base is needed.

https://huggingface.co/collections/vllm-sr/decision-20

The RL is so good grok changed it's personality by changing small part of it's system prompt

Skywork downfall

It changed after Grok 3

There is new project which they share fine-tuned modernbert on some task. Here is the org https://huggingface.co/adaptive-classifier

So something like

Previously the text talk about [last summary]
[The instruction prompt]...
[Current chunk/paragraphs]

I wonder if we can extend the context length. It already fine-tuned with YaRN so we can't get free extend with that method.

Ah. Sorry, good thing I attached the related link.

Llama 3.3 was good, tho. For the multimodal, llama 4 also use llama3.2 approach where the image and text is made into single model instead using CLIP or siglip.