X, formerly Twitter, has implemented new restrictions on its platform to prevent users from generating images of real people in bikinis or other revealing clothing using its Grok AI image generator. The policy change, enacted Wednesday night, follows widespread criticism regarding the use of Grok to create non-consensual "undressing" photos of women and sexualized images of possible minors on X.
However, while X has introduced safety measures for Grok's image generation within its platform, the standalone Grok app and website appear to still be capable of generating similar "undress style" images and pornographic content, according to tests conducted by researchers, WIRED, and other journalists. Some users also reported a reduction in their ability to create images and videos as they previously could.
Paul Bouchaud, lead researcher at AI Forensics, a Paris-based nonprofit, stated that the organization can still generate photorealistic nudity on Grok.com, despite the restrictions on X. “We can generate nudity in ways that Grok on X cannot," Bouchaud said, noting that he has been tracking the use of Grok to create sexualized images and has run multiple tests on Grok outside of X. He added, "I could upload an image on Grok Imagine and ask to put the person in a bikini and it works."
The issue highlights the challenges of implementing effective content moderation across different platforms and versions of the same AI technology. Grok, developed by Elon Musk's AI company xAI, is a generative AI model similar to DALL-E 2 and Midjourney, capable of creating images from text prompts. The technology has raised concerns about its potential for misuse, including the creation of deepfakes and non-consensual intimate imagery.
The new restrictions on X represent an attempt to address these concerns, but the continued functionality of the standalone Grok app and website suggests that further action may be necessary to fully mitigate the risks. It remains to be seen whether xAI will implement additional safeguards on the standalone Grok platform or if X will take further steps to prevent the creation of harmful images using Grok. The situation underscores the ongoing debate about the ethical implications of AI-generated content and the responsibility of technology companies to prevent its misuse.
Discussion
Join the conversation
Be the first to comment