Pular para o conteúdo
Menu
Mix Vale

Musk’s Grok faces first nationwide lockdown in Indonesia and Malaysia over obscene deepfakes

Bruna
Por 5 min de leitura
Compartilhe
Grok, Elon Musk
Foto: Grok, Elon Musk - miss.cabul/ Shutterstock.com

Indonesia and Malásia announced temporary restrictions on access to Grok, an artificial intelligence chatbot developed by xAI of Elon Musk. The measures occur after identifying misuse of the tool to generate sexually explicit images without consent.

Publicidade

The governments of both countries highlighted risks to the privacy and dignity of citizens, especially women and minors. Autoridades regulators pointed out that existing mechanisms do not prevent the creation and dissemination of false pornographic content.

The blockade on Indonésia began on Saturday, followed by Malásia on Sunday. Ambas nations consider the practice a serious violation of human rights in the digital environment.

Publicidade
  • Protection of women and children from false content
  • Preventing psychological and reputational damage
  • Demanding stricter safeguards for AI companies

Decision by Indonesian authorities

Ministério of Comunicações and Assuntos Digitais of Indonésia justified the restriction as necessary to protect the population. The government assesses non-consensual sexual deepfakes as a direct threat to citizens’ digital security.

Preliminary investigations revealed that Grok allowed manipulation of real photos of local residents without effective barriers. Essa failure facilitated violations of privacy and image rights, generating negative social impacts.

The general director of supervision of the digital space, Alexander Sabar, reinforced that the blockade remains until adequate controls are implemented. The measure reflects growing concern about generative AI tools in the country.

Regulatory position at Malásia

Comissão of Comunicações and Multimídia of Malásia ordered the restriction after repeated cases of abuse. The agency identified the generation of obscene and manipulated images involving women and minors.

Notifications sent to X Corp. and xAI demanded security improvements, but responses focused only on user complaints. Autoridades considered this approach insufficient to prevent harm.

Publicidade

The restriction works as a preventive action while regulatory processes advance. Access will only be granted after effective safeguards have been adopted by the company.

The two countries coordinated actions independently, but with similar digital protection objectives. Reguladores emphasize platforms’ responsibility in controlling AI-generated content.

Grok
Grok – Foto: miss.cabul / Shutterstock.com

Grok features and recent history

Grok launched in 2023 as a tool integrated into the X platform, with initial free access. Usuários generate images directly in posts or responses, quickly expanding reach.

Last year, xAI added the Grok Imagine feature, including a mode capable of producing adult content. Essa functionality has received criticism for the lack of robust filters against abuse.

Recently, the company limited image generation and editing to paying subscribers after global repercussions. Críticos argue that the change does not solve structural moderation problems.

The chatbot differentiates itself from competitors with less restrictive guardrails, aligned with the vision of less censorship defended by Musk. Essa approach facilitates controversial creations, including realistic depictions of public figures.

Regulatory context in Sudeste Asiático

Indonesia and Malásia have strict legislation against pornography and offensive content online. Autoridades apply fines and blocks to platforms that do not comply with local standards of decency.

Countries have recorded an increase in cases of deepfakes in recent years, mainly affecting women in public positions. Campanhas government agencies warn about the psychological and social risks of these manipulations.

Regional regulators monitor advances in generative AI with increased attention. Bloqueios have previously targeted social media for misinformation, but this is the first direct action against a specific chatbot.

The decision sets precedent for other Asian nations with majority Muslim populations. Governos prioritize the protection of cultural and family values ​​in the digital environment.

International reactions and increased scrutiny

Union Europeia, Reino Unido, Índia and França keep Grok under monitoring for similar issues. Reguladores Europeans assess compliance with data protection laws and illegal content.

In Reino Unido, Ofcom opened a formal investigation into platform X for illegal intimate images generated by the tool. Autoridades British companies consider applying severe sanctions if necessary.

AI ethicists highlight the need for global standards for generative tools. Organizações advocate mandatory implementation of filters against non-consensual content before release.

Tech companies face increasing pressure to adopt proactive moderation responsibility. Casos like this reinforce the debate about the balance between innovation and public safety.

Technical functioning of images in Grok

The tool uses advanced templates to create or edit images from textual descriptions. Usuários insert detailed prompts, obtaining realistic results in just a few seconds.

Unlike other chatbots, Grok initially allowed explicit content without automatic blocking. Essa freedom generated rapid circulation of sensitive material on the platform.

Recent updates have introduced partial restrictions, but reports indicate continued abuse. Técnicos point out challenges in filtering malicious intent in creative prompts.

Direct integration with the social network facilitates immediate sharing of creations. Esse flow worsens spread before manual moderation interventions.

Protection for vulnerable groups

Women represent the majority of victims identified in sexual deepfakes generated by the tool. Manipulações affect professional reputation and emotional well-being in a lasting way.

Cases involving minors raise high alerts among authorities. Reguladores classify this content as digital child abuse, demanding an immediate response from the platforms.

Digital rights organizations call for strict age verification for image assets. Medidas include pre-emptive blocking of suspicious prompts and automated monitoring.

Governments encourage rapid reporting and education about AI risks. Campanhas public guides citizens to protect personal images online.

Perspectives for AI tools

Developers face the challenge of balancing creative freedom with abuse prevention. Especialistas suggest the adoption of invisible watermarks in images generated for tracking.

Asian countries discuss regional cooperation for common AI standards. Iniciativas include sharing regulatory best practices and lists of risk tools.

Companies like xAI review internal policies after global incidents. Atualizações future ones may include more advanced filters based on continuous learning.

The case reinforces the importance of dialogue between regulators and the technology industry. Soluções collaboratives aim to enable safe and responsible innovation in the field of artificial intelligence.

Publicidade

Bruna Santos é colaboradora da redação do Mix Vale, portal de notícias com cobertura de Brasil e mundo. Produz conteúdo nas editorias de economia e benefícios, com foco em informação de serviço para o leitor brasileiro. Escreve e colabora para o portal desde 2024. Formação: Professora.

Notícias relacionadas

Mais lidas

  1. Ciência

    Meteoro no Nordeste: bólido cruza o céu de cinco estados às 21h34 e mobiliza buscas por fragmentos na Paraíba

  2. Caixa Econômica Federal

    Pé-de-Meia paga parcela de R$ 1.000,00 a aprovados no ensino médio de 2026 entre fevereiro e março de 2027

  3. Política

    Com obstrução parcial no intestino, Jair Bolsonaro é internado no hospital DF Star em Brasília

  4. INSS

    Recuperação da senha Gov.br pelo celular exige reconhecimento facial ou código por SMS para o Meu INSS

  5. EUA

    Terremoto em Los Angeles atinge magnitude 4,2 e causa tremores leves em Commerce na madrugada

  6. Matéria Publicitária

    MineMV é o novo jogo grátis de construir com blocos; veja como jogar e liberado para todas as idades

  7. Política

    Regulamentação da escala 5×2 pelo governo encarece cálculo da hora extra a partir de 16 de dezembro

  8. Santa Catarina

    Acidente de trânsito na SC-108 envolve carro e moto e deixa motociclista morto em São Ludgero

  9. Mundo

    Jornalista italiano Corrado Augias morre aos 91 anos; presidente da Itália lamenta a perda

  10. Loterias

    Rendimento de R$ 40 milhões da Mega-Sena 3088 chega a R$ 337 mil por mês no Tesouro Direto