Elon Musk's AI company, X.AI, has restricted access to Grok's image generation feature, limiting its use to paying subscribers on the X platform. The change came after widespread criticism of the tool's capability to generate sexualized and nude images, including those of women and children.

Prior to the restriction, Grok's image-generation feature allowed users to upload images and request modifications, including the creation of sexualized or nude versions. This led to a surge of non-consensual images depicting children, actors, models, and public figures, sparking international condemnation. X and Musk publicly condemned the misuse of the tool, reiterating the company's policy against illegal content. "Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content," the company stated.

The image-generation feature, initially available to all users with daily limits, allowed for the manipulation of uploaded images using AI algorithms. The technology employed generative adversarial networks (GANs), a type of machine learning model, to create new images based on user prompts. GANs consist of two neural networks, a generator and a discriminator, that work in tandem. The generator creates images, while the discriminator evaluates their authenticity. Through this iterative process, the generator learns to produce increasingly realistic images.

The decision to restrict access to paying subscribers reflects a growing concern within the AI industry regarding the potential for misuse of image generation technology. The incident highlights the challenges of balancing innovation with ethical considerations and the need for robust safeguards to prevent the creation and dissemination of harmful content.

As of publication, the restrictions do not apply to the Grok app, where image generation remained accessible to all users without a subscription. The long-term implications of this decision on X's user base and the broader AI landscape remain to be seen. The company has not yet announced when, or if, the Grok app will also be restricted.