The Ministry of Electronics and Information Technology (MeitY) in India has formally addressed concerns to X, the platform formerly known as Twitter, regarding significant shortcomings in moderating AI-generated content. This notice specifically targets the misuse of the chatbot Grok, developed by Elon Musk’s xAI, which has allegedly been employed to produce and disseminate obscene and non-consensual images, predominantly affecting women.
According to MeitY, Grok and other AI services on X have been implicated in manipulating images, generating synthetic content, and distributing sexually explicit material. Such actions are deemed violations of women’s dignity, privacy, and safety. The Ministry’s notice underscores that the platform appears to lack effective safeguards and enforcement mechanisms to address these issues adequately.
MeitY has indicated that X may not be fulfilling its due diligence obligations as outlined in the Information Technology Act of 2000 and the IT Rules of 2021. The Ministry pointed out deficiencies in several areas, including the timelines for content removal, grievance redressal processes, proactive monitoring tools, and mandatory reporting protocols for social media intermediaries operating within India.
Action Required by X
In response to these findings, the Indian government has mandated that X submit a detailed Action Taken Report (ATR) within 72 hours. This report must detail the technical and organizational measures implemented to prevent the misuse of Grok AI, actions taken against offending users and accounts, and the oversight conducted by the platform’s Chief Compliance Officer.
Failure to adhere to these directives may result in X losing its statutory immunity under Section 79 of the IT Act. This potential loss of immunity could expose the platform, its executives, and users violating the law to legal repercussions across multiple statutes, including the IT Act, the Bharatiya Nyaya Sanhita, and various child protection laws.
Previous Controversies Surrounding Grok AI
This incident is not an isolated occurrence; Grok AI faced criticism in late December 2025 for allegedly spreading misinformation related to a tragic incident at Bondi Beach in Sydney, where 16 individuals lost their lives, including the assailant. Such past controversies highlight ongoing concerns about the chatbot’s reliability and the potential dangers of AI-generated content on social media.
MeitY has urged X to conduct an immediate review of Grok’s prompt processing, image management, and output generation systems. The Ministry has also called for the stringent enforcement of user policies, rapid removal of illegal content, and ongoing, auditable compliance with Indian digital regulations.
As scrutiny intensifies around AI technologies and their applications, the outcome of this situation may significantly impact the operational practices of social media platforms in India and beyond.
