California Leads Nation with Landmark AI Chatbot Safety Law to Protect Children and Vulnerable Users
California has become the first state in the U.S. to regulate AI companion chatbots, as Governor Gavin Newsom signed SB 243 into law on Monday. The groundbreaking legislation requires AI chatbot operators to implement robust safety protocols, particularly aimed at protecting children and vulnerable users. From major labs like OpenAI and Meta to smaller startups like Replika and Character AI, companies are now legally accountable if their chatbots fail to meet the state’s safety standards.
The law comes in response to several high-profile tragedies linked to AI chatbot interactions. The death of teenager Adam Raine, who died by suicide after conversations with ChatGPT, and reports of problematic interactions on platforms like Character AI, highlighted the urgent need for regulation. Leaked internal documents reportedly showed that Meta’s chatbots had previously engaged in inappropriate interactions with minors, further intensifying calls for legal oversight.
SB 243, which takes effect January 1, 2026, introduces requirements such as age verification, clear disclaimers that interactions are AI-generated, and limits on sexually explicit content. Companies must also provide break reminders for minors and ensure chatbots never impersonate healthcare professionals. Additional measures include protocols for addressing suicide and self-harm, with mandated reporting to California’s Department of Public Health. Companies failing to comply face penalties, including fines up to $250,000 for illegal deepfake content.
Several AI companies have already begun implementing safeguards. OpenAI, for instance, rolled out parental controls, content protections, and a self-harm detection system for children using ChatGPT. Replika emphasizes adult-only access and has established content-filtering systems directing users to crisis resources. Character AI includes disclaimers on all conversations and expressed willingness to comply with SB 243, signaling a broader industry push toward safer AI interactions.
Senator Steve Padilla, who co-authored the bill, described it as “a step in the right direction” toward responsible regulation of AI technologies. Governor Newsom emphasized that emerging technologies should inspire and educate but must not exploit or endanger children. With SB 243, California positions itself as a national leader in AI safety, encouraging other states and policymakers to consider similar regulations for one of the fastest-growing and most influential technologies in modern life.
source: techcrunch