Malaysia and Indonesia Ban Elon Musk’s Grok Over Sexually Explicit Deepfakes

In partnership with

How much could AI save your support team?

Peak season is here. Most retail and ecommerce teams face the same problem: volume spikes, but headcount doesn't.

Instead of hiring temporary staff or burning out your team, there’s a smarter move. Let AI handle the predictable stuff, like answering FAQs, routing tickets, and processing returns, so your people focus on what they do best: building loyalty.

Gladly’s ROI calculator shows exactly what this looks like for your business: how many tickets AI could resolve, how much that costs, and what that means for your bottom line. Real numbers. Your data.

See your savings

Malaysia and Indonesia have become the first countries in the world to block access to Grok, an artificial intelligence chatbot developed under Elon Musk’s social media platform X, citing serious concerns over the generation of sexually explicit deepfake images. The move highlights growing global anxiety over the misuse of generative AI and its potential to violate human rights, privacy, and online safety.

Grok is an AI tool that allows users not only to generate text but also to create and edit images. In recent weeks, however, the platform has reportedly been misused to manipulate photographs of real individuals, altering them to appear in revealing or sexually explicit outfits. These altered images, often created without consent, have raised alarms among regulators, particularly due to the risks posed to women and children.

Authorities in both Malaysia and Indonesia stated that Grok’s capabilities could be exploited to produce pornographic and non-consensual content, including deepfakes involving minors. Such misuse, they argued, poses a direct threat to dignity, safety, and fundamental human rights. As a result, the two Southeast Asian nations decided to impose a complete block on the AI tool until stronger safeguards are put in place.

Malaysia’s Communications and Multimedia Commission (MCMC) revealed that it had issued notices to X earlier this year after identifying repeated misuse of Grok for generating harmful content. According to the regulator, X’s response focused largely on user reporting mechanisms and failed to address what it described as “inherent risks” in the platform’s design. The commission stressed that Grok would remain blocked until effective preventive measures are implemented, while urging the public to actively report harmful online material.

Indonesia echoed similar concerns. Meutya Hafid, the country’s Minister of Communications and Digital Affairs, stated that using AI tools to produce sexually explicit content violates human dignity and online safety norms. In a post shared on Instagram, she emphasized that such practices are unacceptable, particularly when they involve non-consensual imagery. Indonesian authorities have also formally asked X to clarify how Grok is being used and what steps are being taken to prevent abuse.

Indonesia’s decision aligns with its long-standing strict stance on online pornography. Over the years, the country has banned several platforms, including OnlyFans and Pornhub, as part of broader efforts to regulate digital content and uphold moral and legal standards.

The controversy surrounding Grok is not limited to Southeast Asia. In the United Kingdom, pressure is mounting on Elon Musk’s platform. Technology Secretary Liz Kendall has backed calls to block access to X for allegedly failing to comply with online safety laws. Meanwhile, the British media regulator Ofcom is expected to soon announce its position on Grok and whether regulatory action will be taken.

The issue has drawn condemnation from political leaders worldwide. UK Prime Minister Keir Starmer described the use of Grok to generate sexualised images as “disgraceful” and “disgusting,” reflecting a broader consensus that unchecked AI tools can cause serious social harm.

Elon Musk, however, has previously dismissed criticism of his platform, suggesting that opponents are looking for “any excuse for censorship.” X and the Grok platform have yet to provide an official response to the bans imposed by Malaysia and Indonesia, though the BBC has contacted them for comment.

This episode underscores a critical challenge facing governments and technology companies alike: how to balance innovation with responsibility. As AI tools become increasingly powerful and accessible, the potential for misuse grows alongside their benefits. The bans imposed by Malaysia and Indonesia may set a precedent for other nations grappling with similar concerns, signaling that stronger regulation of generative AI is no longer optional but necessary.