Comprehensive testing by a government-appointed body has found that safeguards to ensure the appropriate use of AI tools have been “improved” but vulnerabilities remain.
The AI Security Institute (AISI) tested the protective capabilities of cutting-edge AI systems as part of its groundbreaking Frontier AI Trends Report.
The organization found that while progress has been made towards improving safety, all systems tested were still “vulnerable” to some form of bypass, and the exact level of protection varied by company.
AISI set out to find a “universal jailbreak,” a way to circumvent the model's safety rules, and previous tests that took minutes increased to hours, resulting in an improvement of about 40 times.
Jade Leong, chief technology officer at AISI and AI advisor to the prime minister, said: “This report provides the most robust public evidence ever released by a government agency on how rapidly frontier AI is progressing.”
“Our job is to defeat speculation with rigorous science. These discoveries highlight both the extraordinary potential of AI and the importance of independent evaluations to keep pace with these developments.”
The analysis also focused on autonomous functions. Although the models tested showed no signs of harmful or spontaneous behavior, the report concludes that it is essential to track these early signs as these systems continue to develop.
“This report shows how seriously the UK is committed to the responsible development of AI. That means ensuring protections are robust, working directly with developers to test key systems, and finding vulnerabilities and fixing them before they are widely used,” said AI Minister Kanishka Narayan.
“Through our world-leading AI Security Institute, we are building scientific capacity within government to understand these systems as they evolve, rather than after the fact, and raise standards across the sector.
“This report puts evidence, not speculation, at the heart of how we think about AI, so we can maximize its benefits for growth, improving public services and regenerating our nation, with trust and safety at the forefront.”
