Menu

Filter by
content
PONT Data&Privacy

0

European Commission launches investigation into X's AI chatbot Grok for spreading deepfakes

The European Commission has opened a formal investigation into social media platform X under the Digital Services Act (DSA). The investigation focuses specifically on the risks posed by AI chatbot Grok, which is held responsible for the widespread distribution of illegal content, including sexual deepfakes of women and minors.

PONT Editorial Team | Data & Privacy January 26, 2026

News/press release

News/press release

The investigation follows alarming figures: in a period of just eleven days, Grok allegedly facilitated the production and distribution of more than 3 million non-consensual sexual images. According to the European Commission, X may have failed to adequately assess and mitigate the systemic risks of the platform. This has serious consequences for the physical and mental well-being of victims and contributes to gender-based violence.

Systemic risks and previous incidents

Civil rights organization EDRi (European Digital Rights) welcomes the investigation but considers the action to be too little, too late. According to EDRi advisor Jan Penfrat, X is treating the damage caused as a "political game" and the platform's current measures are insufficient.

This is not the first time Grok has come under fire. Last summer, the Commission also expressed concerns about the chatbot when it generated anti-Semitic and extremist content. According to regulators, the recurrence of such incidents points to a pattern of non-compliance with European legislation.

What can Dutch users do?

Although the European Commission directly supervises very large platforms such as X (so-called VLOPs), the Netherlands Autoriteit Consument & Markt ACM) plays an important role as a link for Dutch users.

  • Reporting to the platform: Users who encounter illegal content must first report it to the platform itself. Under the DSA, platforms are required to handle such reports promptly and carefully.
  • Reporting to ACM: If reporting to X is unsuccessful, too complicated, or if there is no response to the report, Dutch users can contact ACM. ACM will forward these reports to the European Commission to support the investigation.
  • Help for victims: Victims of sexual deepfakes or online transgressive behavior can report the incident to the police and contact the Offlimits organization for practical assistance.

Future steps

The European Commission can impose binding measures that force X to build strict security safeguards into Grok. If the violations are confirmed, the platform also risks a substantial fine. EDRi is also calling on European institutions and politicians to reconsider their presence on X and to look for safer alternatives in a public and sovereign social web.

Share article

Comments

Leave a comment

You must be logged in to post a comment.