Establishing oversight of frontier model cyber capabilities
One of the most consequential sections of the order concerns advanced AI systems, often referred to as frontier models.
Within 60 days, the NSA, CISA, Treasury Department, National Institute of Standards and Technology, and other agencies must develop a classified benchmarking process for evaluating the advanced cyber capabilities of AI models. The process will be used to determine when a system should be designated a “covered frontier model.”
The order does not define what capabilities would trigger the designation, instead directing federal agencies to develop classified assessment criteria and benchmarks for assessing advanced cyber capabilities. The NSA will ultimately be responsible for making determinations in consultation with other national security officials. While that approach gives the government flexibility as AI systems evolve, it also leaves unanswered questions about which future models could ultimately fall within the framework.
