X Limits Grok Image Generation Citing Safety Risks to Minors

For the majority of users on the X social media network, Grok’s image-generation capability has been blocked by Elon Musk’s artificial intelligence firm, xAI. This follows concerns that the AI tool was producing sexualised photographs of women and children without permission, the limitation was put in place.

As of Friday, users must have a paid subscription in order to utilise Grok on X to create or modify photos.

On the other hand, users can still freely create photos using the standalone Grok program.

What they stated

In response to the worries, Elon Musk stated that anyone who uses Grok to submit illicit information will be subject to the same penalties as those who publish it directly.

“Those who use Grok to create illicit content will face the same penalties as those who upload illicit content,” he declared.

The content that sexualises and exploits children is expressly prohibited by X’s terms of service.

Geraint Ellis, a spokesman for UK Prime Minister Keir Starmer, condemned the restriction, claiming it fell short. Simply put, the restriction makes an AI feature that permits the production of illegal photos into a premium service.

It’s not a solution; it just turns an AI function that permits the production of illegal photographs into a premium service.

Ellis said that the victims of sexual assault and misogyny are being insulted. It does demonstrate that X is capable of moving quickly when it so chooses.

With additional insights into the distinction between risqué and illegal content, which has been blurred, according to child-safety specialists, who have criticised the AI tool and warned that it is being used to produce video that involves child sexual abuse.

Platforms run the danger of fines or blocks if they don’t take proactive steps to remove such content.

Criminal photographs purportedly created by Grok were found on the dark web by the Internet Watch Foundation, which was appointed by the UK government to monitor child sexual abuse content online.

Starmer confirmed that the government fully supports the measures taken by the British regulator Ofcom.

Everyone should be aware that it is a component of a broader technology platform crackdown in Europe. Also, to determine whether Facebook and Instagram’s algorithms take advantage of children’s inexperience and promote addictive behaviour, European Union officials launched a formal investigation into Meta in 2024.

With the Digital Services Act, the inquiry will look at whether these methods encourage users to view more upsetting content and whether age-verification procedures work.

Meta stated that it has created more than 50 policies and procedures to safeguard underage users, but it acknowledged that the issue affects the entire business. Fines of up to six per cent of worldwide revenue or, in severe circumstances, platform bans could result from violations.

Under the DSA, the EU has also launched comparable investigations into TikTok and is still keeping an eye on other significant sites.

As of Friday January 9th, it is perceived that only paying subscribers are able to create and edit images on X. This makes it possible for X to save complete details and credit card information for users of the tool, making identification easier in the event of misuse.

X also, has put “urgent fixes” in place to address “lapses in safeguards” following reports that Grok produced pictures of children wearing sexualised attire. Requests to create sexualised photos of women, including “bikini images”, are now consistently denied by the chatbot, albeit there are still some irregularities in its stand-alone application.

Musk stated that creating illegal content through Grok carries the same consequences as directly sharing illegal material.

Furthermore, international regulators, with the likes of the United Kingdom, the office of Prime Minister Keir Starmer described the switch to a paid model as “insulting” and “not a solution,” contending that it just transforms an illicit activity into a high-end service. X’s compliance with the Online Safety Act is presently being evaluated by UK regulator Ofcom.

In order to preserve evidence for future investigations, the European Commission also has mandated that X keep all internal records and data pertaining to Grok until the end of 2026.

Due to the dangers of deepfakes, Indonesia was the first nation to restrict access to Grok. India threatened to take away X’s legal safeguards if it didn’t evaluate its technical foundation.