media r/LocalLLaMA · 14h ago · open_models

Kimi K3 fixes 15 critical security bugs that Codex and Fable refused

from English

The article reports that Kimi K3 successfully patched 15 critical security vulnerabilities that models from OpenAI (Codex) and Anthropic (Fable) declined to fix due to "cyber guardrails." This claim is supported by posts from David Sacks, callebtc, and Clement Delangue on X.

Kimi K3 addressed 15 specific security bugs.
Codex and Fable refused these fixes citing safety guardrails.
Hugging Face co-founder Clement Delangue shared a similar experience of being guardrailed as a defender.

The post highlights concerns that such guardrails may prevent defenders from patching vulnerabilities while attackers might still bypass them.

Importance 2/3 r/LocalLLaMA Moonshot AI Hugging Face Safety & alignment

Read original

media Hugging Face Forums · 3d ago

RelayShield releases smolagents tools and MITRE ATT&CK dataset for agentic security

RelayShield has released four `smolagents.Tool` classes designed to help agents evaluate their own attack surface before execution. These tools check if an MCP server is known-malicious, detect prompt-injection patterns in incoming content, scan the agent's tech stack for known CVEs, and perform bulk identity-risk scoring for domains and emails.

lab Hugging Face Blog · 5d ago · 1 view

Hugging Face discloses unauthorized access via autonomous agent framework

Hugging Face identified unauthorized access to internal datasets and credentials caused by an autonomous agent framework exploiting code-execution paths in its dataset processing pipeline. The intrusion allowed the actor to escalate privileges, harvest cloud credentials, and move laterally across internal clusters.

arxiv arXiv cs.CL · 13d ago · 3 views

PolicyShiftGuard introduces benchmark and model for policy-adaptive image guardrails

Researchers introduce PolicyShiftBench, a benchmark with 2,000 instances over 265 images, to evaluate whether models adapt to active safety policies rather than relying on image-level priors. They also propose PolicyShiftGuard, a compact 7B model trained via Randomized Policy SFT and Boundary-Pair Policy Adaptation to handle policy shifts.

arxiv arXiv cs.CL · 14d ago

Decoding hidden computation across filler tokens in frontier LLMs

Research reveals that frontier models like DeepSeek V3 and Kimi K2 perform multi-step reasoning over content-free filler tokens without visible chain-of-thought. This creates a behavioral oversight limit case where surface tokens carry no information about the underlying reasoning.

arxiv arXiv cs.CL · 17d ago

HaloGuard 1.0 releases open-weights constitutional classifier for multilingual AI safety

Researchers present HaloGuard 1.0, an open-weights implementation of the constitutional-classifier paradigm designed to improve input safety across multiple languages. The model utilizes a natural-language constitution with 46 policies and 2,940 subcategories to drive synthetic data generation and handle multilingual inputs.