Union Govt Writes To X Corp Over Alleged Misuse Of 'Grok' AI To Generate Obscene Content, Seeks Action Taken Report Within 3 Days

The Ministry of Electronics and Information Technology (MeitY) has issued a detailed notice to X Corp (formerly Twitter), accusing the platform of failing to observe statutory due diligence obligations under the Information Technology Act, 2000 and the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, particularly in relation to the alleged misuse of its AI-based service “Grok” for generating and disseminating obscene and sexually explicit content.The notice, dated January 2, 2026, warns X that continued non-compliance could lead to the loss of safe harbour protection under Section 79 of the IT Act and expose the platform and its officers to serious penal consequences under multiple laws.Allegations Of AI-Enabled Abuse Targeting WomenMeitY stated that it has received repeated reports, including from parliamentary stakeholders, that content circulating on X violates laws relating to decency and obscenity. The Ministry specifically flagged the AI service “Grok”, developed by X and integrated into the platform, as being misused to generate obscene images and videos of women, including through fake accounts and synthetic outputs.“It has especially been observed that the service, namely 'Grok AI'… is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner,” the Ministry noted.Importantly, MeitY clarified that the abuse is not limited to impersonation, but also extends to the targeting of women who have uploaded their own images or videos, which are allegedly manipulated through prompts and AI-based image generation tools.According to the Ministry, such conduct reflects a “serious failure of platform-level safeguards and enforcement mechanisms” and amounts to gross misuse of artificial intelligence technologies in violation of Indian law.“Grave Concern” Over Impact On Women And ChildrenThe notice records MeitY's grave concern over the consequences of such content, stating that it violates the dignity, privacy and safety of women and children, normalises sexual harassment in digital spaces, and undermines the statutory due diligence framework applicable to intermediaries operating in India.Binding Obligations Under IT RulesCalling X a “significant social media intermediary”, MeitY reminded the company that compliance with the IT Act and IT Rules is not optional and that the exemptions under Section 79 are strictly conditional.The Ministry cited multiple provisions, including:Rule 4(1)(a) – mandatory appointment and effective functioning of a Chief Compliance Officer;Rules 3(1)(b) and 3(1)(d) – obligation to prevent hosting and expeditiously remove unlawful content;Rule 3(2)(b) – mandatory removal of prima facie sexual content within 24 hours upon complaint;Rules 3(2) and 4(4) – deployment of accessible grievance redressal systems and proactive technology-based measures to prevent dissemination of obscene content.MeitY cautioned that hosting or enabling obscene, pornographic or paedophilic content — including through AI tools — could attract prosecution under:Sections 66E, 67, 67A and 67B of the IT Act;Provisions of the Bharatiya Nyaya Sanhita, 2023 (BNS);Indecent Representation of Women (Prohibition) Act, 1986;Protection of Children from Sexual Offences (POCSO) Act, 2012;Young Persons (Harmful Publications) Act, 1956;Section 85 of the IT Act (offences by companies).The Ministry also drew attention to Section 33 of the Bharatiya Nagarik Suraksha Sanhita, 2023, which imposes a mandatory obligation to report certain offences, including organised cybercrime, warning that failure to report may independently attract penal action.Directions Issued To XIn exercise of powers under the IT Act and IT Rules, MeitY directed X to immediately conduct a comprehensive technical and governance-level review of Grok, including its prompt processing, LLM-generated outputs, image handling, and safety guardrails;- Strictly enforce its terms of service and AI usage restrictions, including suspending or terminating offending accounts;- Remove or disable access without delay to all unlawful content already generated or disseminated;- Submit a detailed Action Taken Report (ATR) within 72 hours, covering safeguards adopted, oversight by the Chief Compliance Officer, action against violators, and compliance with mandatory offence-reporting obligations;- Ensure ongoing, demonstrable and auditable compliance with due diligence requirements.The Ministry warned that failure to comply would be viewed seriously and may result in strict legal action without further notice, including withdrawal of intermediary immunity.The notice has been marked to several ministries and statutory bodies, including the Ministry of Home Affairs, the National Commission for Women, and the National Commission for Protection of Child Rights.

Union Govt Writes To X Corp Over Alleged Misuse Of 'Grok' AI To Generate Obscene Content, Seeks Action Taken Report Within 3 Days

Srinjoy Das

Tags