The UK government has urged Ofcom, the country's communications regulator, to consider using its full range of powers, potentially including a ban, against the social media platform X over concerns regarding unlawful artificial intelligence-generated deepfakes appearing on the site. This action stems from growing anxieties about the use of X's AI model, Grok, to create digitally altered images, including those that remove clothing from individuals.

Ofcom's authority under the Online Safety Act allows it to pursue court orders that could prevent third parties from facilitating X's financial operations or its accessibility within the UK. The government's heightened concern arises from the potential for Grok to be used to generate sexualized images, particularly those depicting children.

Prime Minister Sir Keir Starmer condemned the creation of such images, stating, "This is disgraceful. It's disgusting. And it's not to be tolerated. Ofcom has our full support to take action in relation to this." He further emphasized the government's stance, adding, "It's unlawful. We're not going to tolerate it. I've asked for all options to be on the table." Government sources confirmed to BBC News that they expect Ofcom to utilize all available powers in addressing the issue of Grok on X.

Deepfakes, a form of synthetic media, utilize AI, specifically deep learning techniques, to create highly realistic but fabricated images, videos, or audio recordings. The technology raises significant ethical and societal concerns, including the potential for misinformation, defamation, and non-consensual pornography. The ability to convincingly alter images and videos can erode trust in visual information and create challenges in distinguishing between reality and fabrication.

The Online Safety Act grants Ofcom significant regulatory powers to address harmful content online. These powers include the ability to fine companies that fail to protect users from illegal content and, in extreme cases, to block access to websites. The government's urging of Ofcom to consider a ban highlights the severity of its concerns regarding the potential misuse of AI on social media platforms.

The situation underscores the ongoing debate surrounding the regulation of AI and its potential impact on society. As AI technology continues to advance, regulators and policymakers face the challenge of balancing innovation with the need to protect individuals from harm. The outcome of Ofcom's investigation and any subsequent actions taken against X will likely set a precedent for how AI-generated content is regulated in the UK and potentially influence similar discussions in other countries. The regulator is now expected to assess the evidence and determine the appropriate course of action, considering the full scope of its powers under the Online Safety Act.