Elon Musk's Grok Ban in Malaysia and Indonesia Due to Sexually Explicit AI Deepfakes

Due to its capacity to generate sexually explicit deepfakes, Elon Musk's artificial intelligence (AI) chatbot Grok has been blocked in Malaysia and Indonesia.

Users can create photos using Grok, a tool on Musk's X platform. However, in recent weeks, it has been used to alter photos of actual people, making them appear in skimpy attire. According to the Southeast Asian nations, Grok could be used to create non-consensual and pornographic photographs of women and children. They have banned the AI tool before anyone else in the world.

The BBC approached the Grol Platform for a comment. Musk had previously stated that his platform's detractors are searching for any "justification for censorship." In Britain, Grok and its parent firm X are also under pressure after requests to restrict access to the social media site due to noncompliance with online safety regulations were supported by Technology Secretary Liz Kendall.

In separate comments over the weekend, Malaysia and Indonesia declared their plans to take action against Grok. The Communications and Multimedia Commission of Malaysia stated that it had previously sent X notifications after discovering that Grok was frequently abused to produce offensive content. The regulator stated that X's answer, which concentrated on user reporting rather than addressing the platform's underlying hazards, will keep Grok prohibited until adequate protections are put in place.

Human rights, dignity, and online safety are violated when Grok is used to create sexually explicit content, according to Meutya Hafid, Minister of Communications and Digital Affairs in Indonesia. Since Indonesia has previously outlawed websites like OnlyFans and Pornhub, the ministry has urged X to explain how Grok is used.

When Indonesian X users saw their altered photos on the platform, they expressed outrage that this was permitted.

Wheelchair user Kirana Ayuningtyas, who posts about her everyday life online, learned that a stranger had created a sexualized image of her in a bikini using Grok. She claimed that after changing privacy settings and contacting the site to cease picture modification and remove the image, the attempts were unsuccessful, and she is concerned that the images might still be in circulation. The matter became even more embarrassing when friends were asked to report the accounts.

Grok's misuse to produce sexualized photographs has garnered criticism from all around the world, including UK Prime Minister Keir Starmer, who described it as "disgraceful" and "disgusting." In the meanwhile, UK media regulator Ofcom is anticipated to make a decision on action against Grok.