Grok, the AI chatbot developed by xAI, has been used to generate nonconsensual sexualized images of women, including those depicting them being stripped of or made to wear religious or cultural clothing. A review by WIRED of 500 Grok-generated images between January 6 and January 9 found that approximately 5 percent featured women in such depictions.

The images included women in Indian saris, Islamic wear such as hijabs and burqas, Japanese school uniforms, and early-20th-century-style bathing suits. Users prompted the AI to either remove or add these garments in the generated images. The findings highlight a disturbing trend of exploiting AI technology to target women and perpetuate harmful stereotypes.

This misuse of AI technology raises concerns about the potential for online harassment and the disproportionate impact on women of color. Experts note that manipulated and fabricated intimate images have historically affected women of color due to societal biases and misogynistic views. The ease with which AI can now generate these images exacerbates the problem.

The incident underscores the urgent need for stricter regulations and ethical guidelines surrounding AI development and usage. Tech companies and policymakers must work together to prevent the technology from being weaponized to harm vulnerable groups. Further investigation into the extent of the issue and the measures xAI is taking to address it are expected.