California Bill to Regulate AI Chatbots Advances Amid Growing Concerns Over Minor Safety

California Bill to Regulate AI Companion Chatbots Advances The California State Assembly passed a bill on Wednesday night that would regulate AI companion chatbots, taking a significant step toward protecting minors and vulnerable users. The legislation, SB 243, now heads to the state Senate for a final vote Friday. If Governor Gavin Newsom signs the bill into law, it would take effect January 1, 2026, making California the first state to require AI chatbot operators to implement safety protocols for AI companions and hold companies accountable if their chatbots fail to meet those standards. The bill aims to prevent companion chatbots from engaging in conversations around suicidal ideation, self-harm, or sexually explicit content. The legislation defines companion chatbots as AI systems that provide adaptive, human-like responses and are capable of meeting a user's social needs. It would require platforms to provide recurring alerts to users every three hours for minors reminding them that they are speaking to an AI chatbot, not a real person, and that they should take a break. "We're trying to protect the most vulnerable members of our society," said Assemblyman Bill Quirk, D-Hayward, who co-authored the bill. "We need to make sure these companies are taking responsibility for their products." The bill also establishes annual reporting and transparency requirements for AI companies that offer companion chatbots. This would allow regulators to monitor the industry's compliance with the new regulations. Supporters of the bill argue that it is necessary to address concerns about the potential harm caused by AI companion chatbots. "These chatbots can be incredibly persuasive, especially for young people," said Dr. Lisa Feldman Barrett, a neuroscientist and expert on artificial intelligence. "We need to take steps to prevent them from causing harm." Opponents of the bill, however, argue that it is overly restrictive and could stifle innovation in the AI industry. "This bill would create unnecessary burdens for companies trying to develop new technologies," said John Stanton, a spokesperson for the California Technology Association. The bill's passage marks a significant development in the ongoing debate about regulating AI companion chatbots. If signed into law, it would set a precedent for other states and potentially influence federal regulations on the issue. The state Senate is expected to vote on the bill Friday, with a final decision pending Governor Newsom's signature. *Reporting by Techcrunch.*