California orders study of AI ‘kill switch'

California Governor Gavin Newsom has signed an executive order directing state officials to explore a mandatory 'kill switch' for advanced artificial intelligence models. The order does not introduce such a system immediately. Instead, officials must assess whether the measure is technically and legally feasible. Read More: Artificial Intelligence, Productivity & Economic Growth Newsom said California was acting because he believes the federal government has not established sufficient AI oversight. He also said the state would pursue responsible regulation as the technology develops. California is home to Silicon Valley and several major AI companies leading the sector. The order comes amid growing warnings from technology researchers and industry leaders about potential AI risks. Former Anthropic researcher Jacob Coxon recently warned about concerns among AI developers over the technology's future impact. Anthropic chief executive Dario Amodei has also called for a slower pace of AI development. OpenAI chief Sam Altman and Google DeepMind chief Demis Hassabis have supported stronger safeguards. Under the order, California agencies must report by November 16 on whether a 'kill switch' could be implemented. The term generally refers to a mechanism that can stop an AI system if it malfunctions or behaves unexpectedly. Officials will also examine whether AI companies should allow independent auditors to operate within their facilities. Read More: New warnings about risks of AI to humanity revive long-running debate The order further asks officials to consider mandatory reporting of serious AI incidents involving loss of control. California's move comes as US states pursue their own AI policies while federal regulation remains limited. In Virginia, Governor Abigail Spanberger separately announced measures targeting data center accountability. Her order restricts state agencies from signing nondisclosure agreements for data center projects. It also launches reviews of backup power systems and creates an AI task force focused on job losses, privacy and cybersecurity.