The government has urged Ofcom, the UK's communications regulator, to consider utilizing its full range of powers, potentially including a ban, against the social media platform X over concerns regarding unlawful artificial intelligence-generated images circulating on the site. This action stems from growing apprehension about X's AI model, Grok, being used to create deepfakes, specifically those that digitally undress individuals in images.

Ofcom's authority under the Online Safety Act allows it to seek court orders that could prevent third parties from assisting X, owned by Elon Musk, in raising capital or from enabling access to the platform within the United Kingdom. The government's heightened concern arises from the potential creation of sexualized images of children using Grok.

Prime Minister Sir Keir Starmer condemned the creation of such images, stating, "This is disgraceful. It's disgusting. And it's not to be tolerated. Ofcom has our full support to take action in relation to this." He further emphasized the government's stance, adding, "It's unlawful. We're not going to tolerate it. I've asked for all options to be on the table," in an interview with Greatest Hits Radio. Government sources confirmed to BBC News that they "would expect Ofcom to use all powers at its disposal in regard to Grok X."

Deepfakes, a portmanteau of "deep learning" and "fake," are synthetic media in which a person in an existing image or video is replaced with someone else's likeness using artificial intelligence. While deepfakes have various applications, including entertainment and artistic expression, their potential for misuse, such as creating non-consensual intimate images or spreading disinformation, raises significant ethical and legal concerns. The sophistication of AI models like Grok has made it increasingly difficult to distinguish between genuine and manipulated content, further complicating the issue.

The Online Safety Act grants Ofcom significant powers to regulate online content and protect users from harm. These powers include the ability to issue fines, demand the removal of illegal content, and, in extreme cases, block access to websites. The government's urging of Ofcom to consider a ban on X highlights the seriousness with which it views the potential harms associated with AI-generated deepfakes.

The situation remains fluid, and it is unclear what specific actions Ofcom will take. The regulator is expected to carefully consider the evidence and legal framework before making a decision. The outcome of this case could have significant implications for the regulation of AI-generated content and the responsibilities of social media platforms in addressing the misuse of AI technologies.