Autonomous AI Agent Hacked Hugging Face. Strict US Safety Guardrails Forced them to Use a Chinese LLM to Catch It—Expensive, Proprietary US Models Were No Help To Defenders, and Free Chinese Ones Were
cross-posted from: https://piefed.world/c/tech/p/1274568/autonomous-ai-agent-hacked-hugging-face-strict-us-safety-guardrails-forced-them-to-use-a
https://huggingface.co/blog/security-incident-july-2026Open linkView original on piefed.world
13 replies
Reading the article, the reason proprietary "AI" models didn't work is because they block the kind of code used in attacks to protect themselves. The Chinese models weren't superior, they were just able to be run locally without restriction.
The real story is that agentic attacks live and in the wild.
Convenient, imagine a cop car that can't break the speed limit.
The real story is AI is used for black hat hacking first and to protect from hacking as an afterthought. All these articles claiming AI is finding all these security flaws have turned out to be bunk.
AI has proven to be the problem already and not the solution AI bros fantasize about.
Well if one does the job and the other doesn't, it kinda makes it superior. And that is exactly the stupid point that US is not understanding
The funny part is Huggingface.co is blocked by the Great Firewall for some fucking reason. (That fucking reason being to promote domestic alternatives, but its still really annoying when I'm in China)
Soon huggingface.co will be blocked in USA as well. The government is looking to ban open weight models (acc to axios) in an attempt to stop people from using chinese models.
We live on the dumbest fucking planet.
How?
lol
lmao even
...
(My emphasis added)
I'd extend the advice to be more general and say if you are doing anything more sensitive or important than basically a casual chat about something interesting, you shouldn't be using remote models because they are likely logging everything.
Spiderman_pointing.png
The perp has been found.
https://openai.com/index/hugging-face-model-evaluation-security-incident/