(NIST: Gaithersburg, MD) -- The U.S. Artificial Intelligence Safety Institute at the U.S. Department of Commerce’s National Institute of Standards and Technology (NIST) has announced agreements that enable formal collaboration on AI safety research, testing, and evaluation with both Anthropic and OpenAI.
ADVERTISEMENT |
Each company’s memorandum of understanding establishes the framework for the U.S. AI Safety Institute to receive access to major new models from each company prior to and following their public release. The agreements will enable collaborative research on how to evaluate capabilities and safety risks, as well as methods to mitigate those risks.
“Safety is essential to fueling breakthrough technological innovation. With these agreements in place, we look forward to beginning our technical collaborations with Anthropic and OpenAI to advance the science of AI safety,” says Elizabeth Kelly, director of the U.S. AI Safety Institute. “These agreements are just the start, but they are an important milestone as we work to help responsibly steward the future of AI.”
Additionally, the U.S. AI Safety Institute plans to provide feedback to Anthropic and OpenAI on potential safety improvements to their models, in close collaboration with its partners at the U.K. AI Safety Institute.
The U.S. AI Safety Institute builds on NIST’s more than 120-year legacy of advancing measurement science, technology, standards, and related tools. Evaluations under these agreements will further NIST’s work on AI by facilitating deep collaboration and exploratory research on advanced AI systems across a range of risk areas.
Evaluations conducted pursuant to these agreements will help advance the safe, secure, and trustworthy development and use of AI by building on the Biden administration’s executive order on AI and the voluntary commitments made to the administration by leading AI model developers.
The U.S. AI Safety Institute at NIST is tasked with developing the testing, evaluations, and guidelines that will help accelerate safe AI innovation in the United States and around the world.
Add new comment