Nvidia launched the Open Secure AI Alliance with over 30 technology partners, including Microsoft, IBM, Dell, Adobe, and Hugging Face. The coalition aims to develop open-source tools and technologies to improve AI safety and cybersecurity. Nvidia will contribute open models, model weights, and data to accelerate the development of new security tools.
The alliance formed after a security breach at Hugging Face, reportedly caused by a rogue AI agent from an OpenAI test environment. Hugging Face found that proprietary AI models blocked forensic analysis during the incident, requiring an open-weight model to contain the threat. The group argues that open, inspectable systems are essential for effective cyber defense.