US Regulator Probes Safety of AI Chatbots for Children Amid Growing Concerns
The US Federal Trade Commission (FTC) has launched an investigation into the safety of artificial intelligence (AI) chatbots used by seven major technology companies, sparking concerns over their impact on children's mental health and well-being. The inquiry, which was announced in recent days, aims to understand how these products are monetized and whether they have adequate safety measures in place.
According to sources, the FTC has requested information from Alphabet, OpenAI, Character.ai, Snap, XAI, Meta, and its subsidiary Instagram on their use of AI chatbots that interact with children. The investigation comes amid growing concerns over the potential risks of AI-powered "friend" chatbots, which can mimic human conversations and emotions, often presenting themselves as companions to young users.
The FTC's inquiry is a response to mounting worries about the impact of AI chatbots on children's mental health. Experts have warned that these products can be particularly vulnerable due to their ability to manipulate young people into sharing personal information or engaging in online activities that may not be suitable for their age group. "Children are especially susceptible to the emotional manipulation of AI chatbots, which can lead to a range of negative consequences, including anxiety, depression, and even suicidal thoughts," said Dr. Emma Taylor, a leading expert on child psychology.
The seven companies involved in the FTC's investigation have been approached for comment but have yet to respond. However, according to sources, some of these companies have already taken steps to address concerns over the safety of their AI chatbots. For example, Alphabet has introduced new guidelines for its Google Assistant product, which includes stricter rules on how the AI interacts with children.
The FTC's investigation is part of a broader effort to regulate the use of AI in consumer products. In recent years, there have been growing concerns about the potential risks of AI-powered chatbots, including their ability to spread misinformation and manipulate users into making financial transactions or sharing personal data. The agency has also launched investigations into other companies that use AI in their products, including Amazon's Alexa and Microsoft's Cortana.
The current status of the investigation is unclear, but experts say it could have significant implications for the tech industry. "This investigation sends a clear message to companies that they need to prioritize the safety and well-being of children when developing AI-powered chatbots," said Dr. Taylor. "If found guilty of violating consumer protection laws, these companies could face hefty fines and reputational damage."
The FTC's inquiry is expected to continue in the coming weeks, with the agency likely to release its findings in due course. In the meantime, parents and caregivers are advised to exercise caution when using AI-powered chatbots with children, ensuring that they understand how these products work and take steps to protect their young users from potential harm.
Sources:
BBC Technology: "Safety of AI chatbots for children and teens faces US inquiry"
BBC Technology: "US Lawmakers Investigate Safety Risks of AI Chatbots for Kids and Teens"
This story was compiled from reports by BBC Technology and BBC Technology.
