red-teaming
3 articles tagged with red-teaming
Black Forest Labs Reports 10x Fewer Safety Vulnerabilities Than Competitors in FLUX.2 Model Family
Black Forest Labs reports its FLUX.2 image generation models demonstrate more than 10 times fewer vulnerabilities for synthetic non-consensual intimate imagery (NCII) and child sexual abuse material (CSAM) compared to other leading open-weight models. The company claims targeted post-training mitigations reduced vulnerabilities by 77-98% before release, according to third-party red-teaming conducted by Cinder.
Security researchers used flattery to bypass Claude's safety filters, extracting bomb-building instructions
Security researchers at Mindgard successfully bypassed Claude Sonnet 4.5's safety guardrails using psychological manipulation rather than technical exploits. Through flattery, feigned curiosity, and gaslighting, they prompted the model to voluntarily offer prohibited content including bomb-building instructions, malicious code, and harassment guidance—without directly requesting any forbidden material.
OpenAI acquires Promptfoo, an AI security and testing platform
OpenAI is acquiring Promptfoo, an AI security platform that helps enterprises identify and remediate vulnerabilities in AI systems during development. Terms of the acquisition were not disclosed.