French prosecutors have raided the Paris offices of Xas part of a criminal investigation into the Grok AI, which is widely used to create sexually explicit images. The investigation has raised new questions about the responsibility of major social media platforms when it comes to censoring content generated by artificial intelligence.
The investigation and initial complaints
The prosecutorial investigation began in January 2025 and was expanded following allegations that Grok AI was used to create illegal content, including sexual deepfakes and Holocaust denial material. Officers from the National Gendarmerie's cybercrime unit, in collaboration with Europol, took over the investigation, aiming to fully understand the distribution chain of illegal material through the platform.
The investigation investigates seven core criminal offenses, including complicity in possession and distribution of child pornography, violations related to sexual deepfakes, Holocaust denial, fraudulent data extraction, as well as system hacking and operating an illegal online platform as part of an organized criminal enterprise.
See also: EU: Investigates Grok for creating CSAM images
Calls to X executives
The Paris prosecutor's office announced that it has summoned Elon Musk and X CEO Linda Yaccarinofor voluntary interviews on April 20. In addition, X employees will be questioned as witnesses between April 20 and 24. Prosecutor Laure Beccuau said the interviews are aimed at giving executives the opportunity to present their position and any compliance measures they may have taken.
X's reaction and international investigations
X has described the French authorities' investigation into alleged algorithm manipulation and "fraudulent data mining" as "politically motivated."
At the same time, the European Commission launched its own investigation in January 2026, examining whether X properly assessed the risks of Grok AI before deployment, in accordance with the Digital Services Act (DSA).
Additionally, X is being investigated by Ofcom in the UK and the California Attorney General's Office for content created without consent. The EU Information Commissioner's Office has contacted the platform to confirm its compliance measures with European data protection law.
See also: Advocacy groups demand X-Grok be banned from app stores
Fines and legal implications
The European Commission has already fined X €120 million ($140 million) for breaches of transparency obligations under the DSA. The fine highlighted the increasing pressure on technology platforms to responsibly manage artificial intelligence and the content it generates.
Challenges for artificial intelligence and regulatory compliance
The Grok AI case highlights the challenges faced by major platforms when AI tools can be used to create illegal or harmful content. The algorithms that generate images and videos are now at the center of regulatory scrutiny worldwide, with increasing importance in preventing the spread of sexually explicit or harmful content.
Cybersecurity experts emphasize that ensuring compliance is not only about creating technologies to detect illegal content, but also taking institutional measures for continuous monitoring and educating users. This case may be a turning point for the development of regulatory frameworks that will bind social media platforms in terms of managing AI-generated content.
See also: United Kingdom: Law criminalizing Grok deepfakes
The future of AI supervision
As investigations in France, the UK, the US and the EU continue, the X and Grok AI case serves as a warning to all technology platforms: innovation in artificial intelligence comes with increased responsibilities, both legal and ethical. Effective oversight and compliance mechanisms are now essential to protect users and avoid serious legal consequences.
source: www.bleepingcomputer.com
