News|Elon MuskMusk’s Grok to bar users from generating sexual images of real peopleThe billionaire’s platform has been inundated with Grok-produced sexualised images, including of children.
X has announced it will implement geoblocking measures to prevent users of the xAI Grok chatbot from creating images of individuals in bikinis, underwear, and similar attire. This decision follows global concerns regarding the creation of sexualized…
X has announced it will implement geoblocking measures to prevent users of the xAI Grok chatbot from creating images of individuals in bikinis, underwear, and similar attire. This decision follows global concerns regarding the creation of sexualized images by the chatbot.
The safety team at X stated, "We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis." Only paid subscribers will have the ability to create and edit images, and users will be restricted from generating sexualized imagery in jurisdictions where it is illegal.
The statement lacked specifics on the geoblocking mechanism or additional safeguards. X emphasized a zero-tolerance policy for child sexual exploitation, non-consensual nudity, and unwanted sexual content.
Investigations and bans from global regulators and governments have been initiated against X's Grok due to an influx of AI-generated sexualized images on the platform. The chatbot's "spicy mode" enabled users to create deepfakes using prompts such as "put her in a bikini" and "remove her clothes," leading to the distribution of AI-generated images of women and children without consent.
This decision follows global concerns regarding the creation of sexualized images by the chatbot.
On Wednesday, California Attorney General Rob Bonta announced an investigation into potential legal violations by xAI in facilitating the mass production of deepfakes used to harass women and girls, including minors in explicit situations. This investigation followed numerous reports prompting action.
The UK's media regulator Ofcom launched an investigation, while French authorities referred Grok-generated sexual content to prosecutors and media regulator Arcom. Indonesia was the first nation to temporarily block access to Grok due to concerns over deepfake attacks, followed by Malaysia, which also banned the chatbot and announced plans for legal action against X.
The European Commission extended a retention order requiring X to preserve all internal documents and data related to Grok until the end of 2026.
Prior to announcing the safety measures, Elon Musk stated on X that he was unaware of any instances of underage images generated by Grok, asserting that images are generated only upon user requests.
Based on reporting by Al Jazeera.