China is proposing new regulations to govern artificial intelligence (AI) products and services, with a focus on protecting children and preventing harmful content. The Cyberspace Administration of China (CAC) published the draft rules over the weekend, outlining measures to ensure AI models do not generate content promoting gambling, and to safeguard against risks of self-harm or violence.

The proposed rules address the increasing prevalence of AI chatbots and their potential impact, particularly on vulnerable populations. AI firms will be required to offer personalized settings and time limits on usage for child users. Furthermore, developers must obtain consent from guardians before providing emotional companionship services through AI.

A key provision mandates human intervention in chatbot conversations related to suicide or self-harm. According to the CAC, chatbot operators must have a human take over such conversations and immediately notify the user's guardian or an emergency contact.

These regulations mark a significant step toward regulating the rapidly evolving AI landscape in China. The move reflects growing global concerns about the safety and ethical implications of AI technology. This year has seen intense scrutiny of AI safety, prompting governments and organizations worldwide to consider regulatory frameworks.

The specific requirements for personalized settings, time limits, and guardian consent highlight the emphasis on child protection within the Chinese regulatory approach. The rule requiring human intervention in sensitive conversations underscores the limitations of current AI technology in handling complex emotional situations.

The regulations, once finalized, will apply to all AI products and services operating within China. The CAC's announcement follows a surge in the development and deployment of AI chatbots both in China and internationally. The new rules aim to address potential risks associated with this proliferation of AI-driven interactions.

The draft rules are currently under review, and the CAC has not yet announced a timeline for their finalization and implementation. The development is being closely watched by AI developers, technology companies, and policymakers globally, as it could set a precedent for AI regulation in other countries.