Ofcom, the UK's communications regulator, has launched an investigation into Elon Musk's social media platform X, formerly known as Twitter, following concerns about the potential creation and dissemination of sexual deepfakes generated by Grok, X's artificial intelligence chatbot. The investigation, announced Wednesday, centers on whether X has adequate safeguards in place to prevent the AI tool from being used to produce and distribute illicit content, specifically non-consensual intimate images.

The probe will examine X's compliance with the Online Safety Act, which places a legal duty of care on platforms to protect users from illegal content and activity. Ofcom has the power to fine companies up to 10% of their global turnover for breaches of the Act. "Protecting users from illegal content online is our top priority," a spokesperson for Ofcom stated. "We are investigating X to assess whether they have taken sufficient steps to prevent Grok AI from being used to create and share illegal deepfakes."

Deepfakes, a portmanteau of "deep learning" and "fake," are synthetic media in which a person in an existing image or video is replaced with someone else's likeness. This technology, powered by sophisticated AI algorithms, has raised significant concerns about misinformation, privacy violations, and the potential for malicious use, including the creation of non-consensual pornography. Grok, X's AI chatbot, is a large language model (LLM) trained on a massive dataset of text and code, enabling it to generate human-like text, translate languages, and answer questions. The concern is that users could prompt Grok to create sexually explicit images of individuals without their consent.

The investigation highlights the growing challenges of regulating AI-generated content and the responsibilities of platforms that deploy these technologies. Experts argue that while AI offers numerous benefits, it also presents new avenues for abuse. "The rapid advancement of AI technologies like Grok necessitates proactive measures to mitigate potential harms," said Dr. Anya Sharma, a professor of AI ethics at the University of Cambridge. "Platforms must implement robust safeguards to prevent the creation and dissemination of deepfakes, particularly those that are sexually explicit and non-consensual."

X has not yet issued a formal statement regarding the Ofcom investigation. However, Musk has previously stated his commitment to combating the misuse of AI on the platform. The outcome of the investigation could have significant implications for X and other social media companies that are integrating AI into their services. Ofcom's findings will likely influence the development of regulatory frameworks for AI-generated content both in the UK and internationally. The investigation is ongoing, and Ofcom is expected to provide updates as it progresses.