Elon Musk’s AI chatbot Grok won’t be able to edit photos to portray real people in revealing clothing in places where that is illegal, according to a statement posted on X.
The announcement late Wednesday followed a global backlash over sexualized images of women and children, including bans and warnings by some governments.
The pushback included an investigation announced Wednesday by the state of California, the U.S.’s most populous, into the proliferation of nonconsensual sexually explicit material produced using Grok that it said was harassing women and girls.
Initially, media queries about the problem drew only the response, “legacy media lies.”
Musk’s company, xAI, now says it will geoblock content if it violates laws in a particular place.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis, underwear and other revealing attire,” it said.
The rule applies to all users, including paid subscribers, who have access to more features.
xAI also has limited image creation or editing to paid subscribers only “to ensure that individuals who attempt to abuse the Grok account to violate the law or our policies can be held accountable.”
The Associated Press confirmed on Thursday morning that the image editing tool was still available to free users on X using the “Edit image” button, as well as on the standalone Grok website and app. The tool was also able to generate images of people in bikinis on a free account based in California.
Grok’s “spicy mode” had allowed users to create explicit content, leading to a backlash from governments worldwide.
Malaysia and Indonesia took legal action and blocked access to Grok, while authorities in the Philippines said they were working to do the same, possibly within the week. The U.K. and European Union were investigating potential violations of online safety laws.
France and India have also issued warnings, demanding stricter controls. Brazil called for an investigation into Grok’s misuse.
The British government, which has been one of Grok’s most vociferous critics in recent days, has welcomed the change, while the country’s regulator, Ofcom, said it would carry on with its investigation.
“I shall not rest until all social media platforms meet their legal duties and provide a service that is safe and age-appropriate to all users,” Technology Secretary Liz Kendall said.
California Attorney General Rob Bonta urged xAI to ensure there is no further harassment of women and girls from Grok’s editing functions.
“We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material,” he said.
California has passed laws to shield minors from AI-generated sexual imagery of children and require AI chatbot platforms to remind users they aren’t interacting with a human.
But Democratic Gov. Gavin Newsom also vetoed a law last year that would have restricted children’s access to AI chatbots.
Pan Pylas in London contributed to this report.
