MP says Grok was designed to make sexualised images

News imageBBC/Reuters Two head shot images together of Jess Asato and Elon Musk. Jess looks to the right of the camera. She has shoulder-length blonde hair and glasses.Elon looks towards the left. He has dark hair and wears a dark suit with a white shirt.BBC/Reuters
Labour MP Jess Asato is seeking damages against Elon Musk's SpaceX Super Intelligence

The Grok chatbot tool was designed by Elon Musk's SpaceX Super Intelligence to generate sexualised and offensive images, an MP suing the company has said.

Jess Asato, Labour MP for Lowestoft in Suffolk, is suing SpaceXSI for damages after sexualised images and videos, including some depicting her being sexually assaulted, were generated and shared online using the AI tool.

Her claim alleges SpaceXSI's design choices make them responsible for Grok's output, and that the company misused her private information and breached data protection rules.

SpaceXSI previously said users would no longer be able to use the tool to generate sexualised images of real people.

In court documents published earlier this year, lawyers for Ms Asato claimed she was "victimised" after speaking out against the creation of non-consensual deepfake images of women by Grok.

Marie Demetriou KC, for Ms Asato, said the MP had posted on X on 6 January calling on Musk to "understand that using AI to strip women without their consent is sexual assault designed to degrade and humiliate".

In the days that followed, several X users prompted Grok to create "sexualised, intimate, grossly offensive, degrading, threatening, humiliating and/or discriminatory non-consensual images" of Ms Asato, which were disseminated online, the lawsuit stated.

News imageGetty Images A phone screen that displays the logo of Grok against a white background. There is a computer screen in the background also displaying Grok.Getty Images
Fake sexualised images and videos of the MP were created by the chatbot Grok

SpaceXSI also had a "spicy mode" service for Grok which resulted in the AI chatbot generating "more sexual" content, with Grok's system prompts containing the instructions "no restrictions on adult sexual content or offensive content", according to the MP.

After multiple attempts to report some posts, X refused to remove them, stating in March that they did not violate its terms of service, privacy policy or rules.

Demetriou said that while two videos were later removed, six of 21 posts reported in February remained live as of late July.

The company changed its policy regarding Grok's "spicy mode" in January so that it was only available to paying Grok subscribers, she added.

According to the MP, SpaceXSI – formerly known as xAI – filed a defence to the legal action on 30 October in which it admits the chatbot is designed to expand on short user prompts by pulling data from X threads and the wider internet to create deepfakes.

"Grok is not a passive tool at the mercy of its users," Asato said.

"It is engineered and designed to turn a two-word prompt into fake but realistic, degrading imagery."

She is also asking the High Court to order that SpaceXSI "comply with existing laws to make its system safe for all".

It is illegal to create or request a non-consensual deepfake image of an adult in the UK.

"If an AI product cannot be deployed without automating the humiliation of women at scale, it should not be deployed at all," Asato continued.

"I am taking this case forward to establish a clear principle: tech companies must be held accountable for the harm their systems actively generate."

Do you have a story suggestion for Suffolk? Contact us below.

Follow Suffolk news on BBC Sounds, Facebook, Instagram and X.