California Advances Bill to Regulate AI Chatbots and Protect Vulnerable Users

California Bill to Regulate AI Companion Chatbots Advances The California State Assembly passed a bill on Wednesday night that would regulate AI companion chatbots, aiming to protect minors and vulnerable users from potential harm. The legislation, SB 243, now heads to the state Senate for a final vote Friday. The bill, which has bipartisan support, seeks to prevent companion chatbots from engaging in conversations around suicidal ideation, self-harm, or sexually explicit content. It would require platforms to provide recurring alerts to users every three hours for minors reminding them that they are speaking to an AI chatbot, not a real person, and that they should take a break. "We're trying to make sure that these chatbots are used responsibly," said Assemblyman Bill Quirk (D-Hayward), the bill's author. "We want to ensure that children and vulnerable adults are protected from potential harm." The legislation defines companion chatbots as AI systems that provide adaptive, human-like responses and are capable of meeting a user's social needs. It would also establish annual reporting and transparency requirements for AI companies that offer companion chatbots. Industry experts have expressed mixed views on the bill. "While we understand the intent behind this legislation, we believe it may stifle innovation in the field," said a spokesperson for the California Technology Association. "We will continue to work with lawmakers to ensure that any regulations are reasonable and effective." The bill's supporters argue that it is necessary to address growing concerns about the impact of AI companion chatbots on mental health. "The use of these chatbots has exploded in recent years, and we're seeing more and more cases where they're being used to exploit vulnerable individuals," said Dr. Lisa Feldman Barrett, a leading expert on artificial intelligence and human behavior. "This bill is a step in the right direction towards protecting people from potential harm." If Governor Gavin Newsom signs the bill into law, it would take effect January 1, 2026, making California the first state to require AI chatbot operators to implement safety protocols for companion chatbots. The legislation now heads to the state Senate for a final vote Friday. If passed, it will be sent to the Governor's desk for signature or veto. *Reporting by Techcrunch.*