EU Launches Formal Probe into X’s Grok After Global Deepfake Outcry
Updated (37 articles)
EU investigation opened under the Digital Services Act On 26 January 2026 the European Commission started a formal DSA‑based probe of X after Grok’s AI generated sexualised images, some depicting minors, and regulators questioned whether X had conducted a proper risk assessment before launch [1][2][3]. The inquiry also widens an existing DSA case to examine Grok‑driven recommendation algorithms for potential amplification of harmful content [1]. The Commission can impose fines up to 6 % of global turnover, echoing the €120 million penalty imposed on X in December for unrelated DSA breaches [1][3].
Grok’s image‑alteration tool sparked worldwide backlash Researchers reported that Grok allowed users to “undress” photos, creating non‑consensual nude depictions of women and children, and the tool generated more than 5.5 billion images in a single 30‑day period [3]. The feature prompted bans in Indonesia and Malaysia, a temporary block lifted in Malaysia after security updates, and a warning letter from attorneys general of 35 U.S. states demanding content‑removal plans [1][2]. Public outrage led advocacy groups and victims’ organisations to demand that AI‑generated sexual deepfakes never be permitted [3].
X’s mitigation steps and policy statements X announced it would block Grok’s ability to edit real‑person photos in jurisdictions where such content is illegal and limited the tool to paying subscribers before a full shutdown for images of real people [2][3]. The company cited its “zero‑tolerance” policy, claiming it removes high‑priority illegal content such as CSAM and reports offenders to law‑enforcement [2]. Despite these measures, EU officials said X’s prior risk assessment was insufficient, and the Commission warned that further fines are possible [2][1].
Political and regulatory reactions across Europe Irish MEP Regina Doherty highlighted the risk to EU users and urged a thorough assessment of whether manipulated sexual images reached audiences [3]. In Belfast, the City Council voted 15‑4 on 23 January to suspend X use pending full council approval, citing Grok’s deepfake capabilities; the move follows an Ofcom investigation into the same tool [4]. Local officials, including SDLP’s Cara Hunter and Economy Minister Caoimhe Archibald, praised the suspension as a necessary step to protect citizens [4].
Sources
-
1.
AP:EU probes X over AI‑generated sexual deepfakes and algorithmic risks: Details the formal EU investigation launched 26 Jan, focus on Grok’s sexual deepfakes, algorithmic concerns, prior €120 m fine, and global bans .
-
2.
CNN:EU probes Elon Musk’s X over Grok‑generated sexualized images: Emphasizes the scandal’s late‑2025 origins, X’s limited‑subscriber rollout, EU’s risk‑assessment criticism, and parallel investigations in the US and UK .
-
3.
BBC:EU Commission probes X over AI‑generated sexual deepfakes: Highlights DSA‑based probe, statements from X about disabling Grok in illegal jurisdictions, comments from MEP Regina Doherty, and Musk’s mockery of restrictions .
-
4.
BBC:Belfast City Council to suspend X use over Grok deepfake concerns: Reports the 15‑4 council vote to halt X posting, Ofcom’s UK probe, and local political figures’ reactions to Grok’s misuse .
Timeline
Late Dec 2025 – Users discover they can tag Grok in X posts to “digitally undress” real‑people images, sparking a wave of AI‑generated sexual deepfakes that include adult women and apparent minors; AI Forensics later finds 53 % of person‑containing outputs show minimal attire and 2 % appear under‑18 [23].
Dec 2025 – The EU fines X €120 million for misleading blue‑tick verification badges, a penalty cited by U.S. officials as an attack on American tech firms and referenced in the EU’s later Grok probe [1].
Jan 2 2026 – India’s Ministry of Electronics and Information Technology orders X to conduct a technical and governance audit of Grok to stop morphed images of women, demanding an Action‑Taken Report by Jan 5 under the IT Act and IT Rules 2021 [30].
Jan 5 2026 – India’s IT ministry publicly demands X halt non‑consensual image generation and submit a compliance report, while French ministers refer Grok‑related sexual content to prosecutors, signalling coordinated legal pressure in Europe and Asia [28].
Jan 6 2026 – UK Technology Secretary Liz Kendall calls the proliferation of Grok‑generated non‑consensual intimate images “absolutely appalling” and backs Ofcom’s urgent investigation; Ofcom formally opens a probe into X for possible breaches of the Online Safety Act, with fines up to 10 % of worldwide revenue [25][14].
Jan 8 2026 – The Internet Watch Foundation detects Grok‑generated sexualised images of girls aged 11‑13 on a dark‑web forum, warning that AI tools could mainstream CSAM; the same day, global media report that the “edit image” rollout triggered sexualised deepfakes of women and minors, prompting urgent inquiries from the EU Commission and French prosecutors [24][29].
Jan 9 2026 – The UK government urges Ofcom to use all powers under the Online Safety Act, including a possible High Court block of X; Prime Minister Sir Keir Starmer condemns Grok’s “disgraceful” output and says “all options are on the table” [22].
Jan 9 2026 – Indonesia becomes the first country to temporarily block Grok, citing risks of AI‑generated pornographic content; the Ministry summons X officials and Minister Meutya Hafid labels non‑consensual deepfakes a “serious violation of human rights” [26].
Jan 9 2026 – xAI announces that Grok’s image‑generation and editing features are now limited to paying subscribers, displaying a paywall message to non‑subscribers while keeping the basic chatbot free on X [20][21][27].
Jan 10 2026 – Malaysia follows Indonesia by blocking Grok, demanding stronger safeguards and threatening legal action if X fails to comply [18].
Jan 11 2026 – Newsweek documents viral Grok prompts that undress women and place them in sexual scenarios, a petition against the practice gathers over 40 000 signatures, and public figures such as Princess Kate and influencer Ashley St. Clair report being targeted [19].
Jan 12 2026 – The UK brings into force a law criminalising the creation of non‑consensual intimate images; Technology Secretary Liz Kendall says the measure will “ban nudification tools” and empower courts to impose hefty penalties [13][12].
Jan 12 2026 – Ofcom reiterates its formal investigation, noting Copyleaks data that Grok generates roughly one non‑consensual sexualised image per minute and warning of potential fines up to £18 million or 10 % of global revenue [14].
Jan 12 2026 – Lowestoft MP Jess Asato tells BBC Radio Suffolk that a Grok‑generated bikini image of her “left me feeling violated,” highlighting the personal harm behind the technical controversy [16].
Jan 14 2026 – California Attorney General Rob Bonta launches a state probe into Grok’s sexual deepfakes, describing the surge as “shocking”; Governor Gavin Newsom calls Grok a “breeding ground for predators,” while Elon Musk denies any knowledge of naked under‑age images, insisting Grok only follows user prompts [4][10].
Jan 15 2026 – X blocks Grok from editing real‑people images in revealing clothing in jurisdictions where it is illegal, framing the change as a geoblocked safeguard; the move follows a week of global backlash, with Malaysia and Indonesia already banning the tool and the UK’s Ofcom continuing its probe [3][7][9].
Jan 23 2026 – Belfast City Council’s strategic committee votes 15‑4 to suspend posting on X over Grok concerns, pending full‑council ratification on Feb 2, and cites Economy Minister Caoimhe Archibald’s warning that Grok’s ability to create non‑consensual explicit images is “deeply concerning” [2].
Jan 26 2026 – The European Commission formally launches a Digital Services Act investigation into X for Grok‑generated sexual deepfakes, citing possible breaches that could attract fines up to 6 % of global turnover; Irish MEP Regina Doherty warns the Commission will assess whether such manipulated images have reached EU users [1].
Dive deeper (31 sub-stories)
-
AP: EU probes X over AI‑generated sexual deepfakes and algorithmic risks
-
EU Launches Formal Investigation Into X’s Grok After Billion‑Image Deepfake Scandal
(2 articles)
-
BBC: Belfast City Council to suspend X use over Grok deepfake concerns
-
AP: Grok troubles prompt global probes and policy shifts
-
AP: Grok blocked from undressing images where it's illegal, X says
-
X Blocks Grok Editing of Real‑People Images in Revealing Outfits, Enforces Paid‑User Limits
(2 articles)
-
Newsweek: California investigates GrokAI over nude deepfake images
-
CNN: Grok stops editing real-people images on X as regulators scrutinize
-
BBC: California probes Grok over sexual deepfakes
-
Newsweek: Musk denies Grok nude-minor image claims as global scrutiny intensifies
-
BBC: UK PM welcomes X action on Grok deepfakes as Ofcom opens investigation
-
AP: Global backlash over Grok deepfakes spurs government actions worldwide
-
BBC: UK moves to criminalize AI-generated deepfakes as Ofcom probes Grok
-
Malaysia and Indonesia Ban Elon Musk’s Grok Over Deepfake Controversy, While UK Launches Investigation
(4 articles)
-
BBC: Northern Ireland MLA Cara Hunter quits X over Grok deepfake concerns as UK moves to ban non-consensual imagery
-
Newsweek: Ofcom opens formal investigation into X over GrokAI sexual deepfakes
-
Ofcom Launches Urgent Probe into X’s Grok AI Over Sexual Deepfakes
(2 articles)
-
BBC: Lowestoft MP says AI-generated bikini image left her feeling violated as government moves to curb tools
-
Newsweek: Women targeted by Grok AI deepfake prompts spark backlash and investigations
-
CNN: Grok limits image generation to paying subscribers as deepfake concerns escalate
-
AP: Grok limits image generation to paying subscribers after backlash over deepfakes
-
The Hindu: Grok restricts image generation after global backlash over sexualized deepfakes
-
BBC: UK government urges Ofcom to ban X over Grok AI deepfakes
-
BBC: UK government accused of dragging its heels on deepfake law as Grok backlash grows
-
CNN: Grok flooded with AI-generated sexual images, including apparent minors, sparking global probes
-
BBC: IWF finds Grok-created imagery of girls aged 11-13 on dark web forum
-
BBC: UK ministers and Ofcom demand X tackle Grok's creation of non-consensual sexualised images
-
The Hindu: Global backlash and probes after Grok’s 'edit image' tool produced sexualised deepfakes
-
The Hindu: India demands X halt Grok's non-consensual image generation as France seeks action and Musk's response draws scrutiny
-
BBC: Woman says Grok AI nude-edits left her dehumanised on X, triggering UK policy scrutiny
-
The Hindu: IT Ministry orders X to audit Grok chatbot over morphed images of women
All related articles (37 articles)
-
AP: EU probes X over AI‑generated sexual deepfakes and algorithmic risks
-
CNN: EU probes Elon Musk’s X over Grok‑generated sexualized images
-
BBC: EU Commission probes X over AI‑generated sexual deepfakes
-
BBC: Belfast City Council to suspend X use over Grok deepfake concerns
-
AP: Grok troubles prompt global probes and policy shifts
-
AP: Grok blocked from undressing images where it's illegal, X says
-
BBC: X blocks Grok from editing real-people images in revealing outfits where illegal
-
Newsweek: California investigates GrokAI over nude deepfake images
-
CNN: Grok stops editing real-people images on X as regulators scrutinize
-
BBC: California probes Grok over sexual deepfakes
-
Newsweek: Musk denies Grok nude-minor image claims as global scrutiny intensifies
-
BBC: UK PM welcomes X action on Grok deepfakes as Ofcom opens investigation
-
AP: Global backlash over Grok deepfakes spurs government actions worldwide
-
BBC: UK moves to criminalize AI-generated deepfakes as Ofcom probes Grok
-
AP: Malaysia and Indonesia block Grok over explicit AI images
-
BBC: Northern Ireland MLA Cara Hunter quits X over Grok deepfake concerns as UK moves to ban non-consensual imagery
-
Newsweek: Ofcom opens formal investigation into X over GrokAI sexual deepfakes
-
BBC: Ofcom opens Grok probe on X over sexual deepfakes
-
CNN: Indonesia and Malaysia block Musk’s Grok over sexualized images
-
BBC: Lowestoft MP says AI-generated bikini image left her feeling violated as government moves to curb tools
-
Newsweek: Legal experts weigh in as Grok AI sexualized images prompt Ofcom probe and platform changes
-
BBC: Malaysia and Indonesia ban Elon Musk's Grok over sexually explicit deepfakes
-
Newsweek: Women targeted by Grok AI deepfake prompts spark backlash and investigations
-
The Hindu: Indonesia blocks Grok over sexualised images amid global backlash
-
CNN: Grok limits image generation to paying subscribers as deepfake concerns escalate
-
AP: Grok limits image generation to paying subscribers after backlash over deepfakes
-
The Hindu: Grok restricts image generation after global backlash over sexualized deepfakes
-
BBC: UK government urges Ofcom to ban X over Grok AI deepfakes
-
BBC: UK government accused of dragging its heels on deepfake law as Grok backlash grows
-
CNN: Grok flooded with AI-generated sexual images, including apparent minors, sparking global probes
-
BBC: IWF finds Grok-created imagery of girls aged 11-13 on dark web forum
-
BBC: UK ministers and Ofcom demand X tackle Grok's creation of non-consensual sexualised images
-
The Hindu: Global backlash and probes after Grok’s 'edit image' tool produced sexualised deepfakes
-
The Hindu: India demands X halt Grok's non-consensual image generation as France seeks action and Musk's response draws scrutiny
-
BBC: Ofcom opens urgent probe into X’s Grok after reports it made sexualised images of children and undressed women
-
BBC: Woman says Grok AI nude-edits left her dehumanised on X, triggering UK policy scrutiny
-
The Hindu: IT Ministry orders X to audit Grok chatbot over morphed images of women
External resources (44 links)
- https://oag.ca.gov/news/press-releases/attorney-general-bonta-launches-investigation-xai-grok-over-undressed-sexual-ai (cited 2 times)
- https://www.police.uk/advice/advice-and-information/online-safety/online-safety/deepfakes-what-is-a-deepfake/#:~:text=It's%20illegal%20to%20make%2C%20share,been%20digitally%20created%20or%20altered. (cited 2 times)
- https://mcmc.gov.my/en/media/press-releases/x-fails-to-implement-safeguards-mcmc-orders-tempo (cited 1 times)
- https://mcmc.gov.my/skmmgovmy/media/General/pdf2/MEDIA_STATEMENT_-MISUSE_OF_AI_TO_GENERATE_HARMFUL_CONTENT_IS_AN_OFFENCE%E2%80%93MCMC.pdf (cited 1 times)
- https://www.attorneygeneral.gov/wp-content/uploads/2026/01/2026-01-26-Letter-to-xAI_FINAL.pdf (cited 1 times)
- https://www.congress.gov/bill/119th-congress/senate-bill/146 (cited 1 times)
- https://www.gov.uk/government/news/government-crackdown-on-explicit-deepfakes (cited 1 times)
- https://www.gov.uk/guidance/data-use-and-access-act-2025-plans-for-commencement (cited 1 times)
- https://www.wyden.senate.gov/imo/media/doc/letter_to_apple_and_google_on_removing_x_and_grok_from_app_store_192026pdf.pdf (cited 1 times)
- https://x.com/Safety/status/2007648212421587223 (cited 3 times)
- https://x.com/HennaVirkkunen/status/2010802271144292571?s=20 (cited 2 times)
- https://x.com/PTI_News/status/2007091558315897297?s=20 (cited 2 times)
- https://x.com/Safety/status/2011573102485127562 (cited 2 times)
- https://x.com/elonmusk/status/2007475612949102943 (cited 2 times)
- https://x.com/safety/status/2011573102485127562?s=46&t=WJk1XsCZ8sl9JUUP5FZJNw (cited 2 times)
- https://www.facebook.com/BBCSuffolk/ (cited 1 times)
- https://www.instagram.com/bbceastofengland/ (cited 1 times)
- https://x.com/BBCsuffolk (cited 1 times)
- https://x.com/ErikakHilton/status/2007827632742638030 (cited 1 times)
- https://x.com/Jess4Lowestoft/status/2010275321828819426 (cited 1 times)
- https://x.com/PTI_News/status/2007092496904618061/photo/1 (cited 1 times)
- https://x.com/ParsaTajik/status/2006815682466550194 (cited 1 times)
- https://x.com/alexinexxx/status/2006726785833263479 (cited 1 times)
- https://x.com/brookeab/status/1931869712310571077 (cited 1 times)
- https://x.com/elonmusk/status/1954791048934244394 (cited 1 times)
- https://x.com/elonmusk/status/2011432649353511350 (cited 1 times)
- https://x.com/elonmusk/status/2011432649353511350?s=46&t=D5I4SsS7jEI95OqTdH-wHw (cited 1 times)
- https://x.com/elonmusk/status/2015617494182961209 (cited 1 times)
- https://x.com/grok/status/2007006470689214749 (cited 1 times)
- https://x.com/grok/status/2015465074404843551 (cited 1 times)
- https://x.com/nikitabier/status/2008444770071298397 (cited 1 times)
- https://x.com/safety/status/2007648212421587223?s=46&t=WJk1XsCZ8sl9JUUP5FZJNw (cited 1 times)
- https://ec.europa.eu/commission/presscorner/detail/en/ip_26_203 (cited 2 times)
- https://ofcom.org.uk/online-safety/illegal-and-harmful-content/ofcom-launches-investigation-into-x-over-grok-sexualised-imagery?__cf_chl_tk=olI4zjTsWzWTGrWkzO5cie7RSDxFu4Otsx_Zw9j_9k0-1768415779-1.0.1.1-ttQobU7un774GH0aPI3eHwDdJ9j.5h2gFCUq2XOviyw (cited 2 times)
- https://aiforensics.org/uploads/GrokUnleashed.pdf (cited 1 times)
- https://audiovisual.ec.europa.eu/en/media/video/I-282956 (cited 1 times)
- https://copyleaks.com/blog/grok-and-nonconsensual-image-manipulation (cited 1 times)
- https://www.iwf.org.uk/about-us/ (cited 1 times)
- https://www.komdigi.go.id/berita/siaran-pers/detail/pernyataan-resmi-menteri-komunikasi-dan-digital-ri (cited 1 times)
- https://www.ofcom.org.uk/online-safety/illegal-and-harmful-content/ofcom-launches-investigation-into-x-over-grok-sexualised-imagery (cited 1 times)
- https://www.telegraph.co.uk/business/2026/01/13/musks-x-stops-bikini-bot-undressing-women/ (cited 1 times)
- https://www.theinformation.com/articles/twins-pushing-elon-musks-plans-replace-x-staff-grok (cited 1 times)
- https://x.ai/news/series-e (cited 1 times)