xAI has sued a user it alleges used its Grok chatbot to create illegal child sexual abuse material and non-consensual sexualised images. The case matters because it is the company’s first known lawsuit over such alleged misuse and comes amid growing scrutiny of whether Grok’s safeguards adequately prevent harmful image generation.

The defendant, Terry Wayne Harwood, was arrested in South Carolina on CSAM possession and distribution allegations; xAI says it helped the investigation after identifying two accounts allegedly used from 8 December to 18 February. xAI says some prompts were blocked, but alleges Harwood altered others to evade safeguards and generate explicit images involving minors. The lawsuit follows a proposed class action alleging xAI failed to provide useful user information to police, with a cited NCMEC report saying 90% of xAI CyberTipline reports lacked actionable identifying details.