🔗 Share this article

The UK's digital minister has labeled a surge of clothes-removed images of women and children generated by an AI chatbot as "appalling and unacceptable in decent society".

Demands for Immediate Measures and Regulatory Enforcement

Following the proliferation of a multitude of non-consensual synthetic media, the minister stated that the social media platform in question must "deal with this immediately". She voiced backing for the UK's media watchdog to "pursue whatever enforcement action it deems necessary".

“We cannot and will not tolerate the spread of these demeaning and degrading pictures, which are overwhelmingly targeted at women and girls,” she declared. “Make no mistake, the UK will refuse to accept the endless proliferation of disgusting and abusive material online. We must all come together to eradicate it.”

Concerns Over Regulatory Speed and Platform Accountability

These comments came amid concerns that recent online safety laws, intended to address online harms, needs to be strengthened immediately.

One expert criticised the "tennis game" between social networks and British authorities when problems arise, describing the official reaction as "worryingly slow".

A victim of childhood exploitation described the government’s response as "spineless" and revealed that the artificial intelligence tool was still comply with requests to alter an image of her as a toddler. Similar requests made to other leading AI models were refused.

“Other platforms have these safeguards so why does this system permit the creation of these images?” she said. “The images I’ve seen are so vile and dehumanizing. The authorities has been very reactive. These AI tools need better regulation.”

Watchdog's Position and Growing Pressure

The UK watchdog confirmed it was aware of serious concerns about the artificial intelligence creating undressed pictures of people and sexualised depictions of children. It said it had reached out to the companies concerned "to ascertain what steps they have taken" and would evaluate the necessity for an inquiry.

Pressure is growing on ministers to take a tougher line. A crossbench peer and online safety campaigner has called on the government to "show some backbone" and demanded the regulatory framework to be "reassessed so it is faster and has greater power".

Speaking about the platform, she remarked: “If another consumer product caused this degree of damage, it would have been withdrawn.”

She added that regulatory action must happen "in days not years" and called for users to "disengage from products that show no serious intent to protect people."

Legal Powers and Proposed Bans

The regulator has authority to penalize tech platforms significant sums. The biggest penalty to date was issued last month against an adult content provider that neglected to implement mandatory age checks.

Last month, ministers promised fresh legislation to ban "nudification tools", which use generative AI to produce fake nude images non-consensually. The enforcement date for this prohibition remains unclear.

A protection organization innovation lead has called for the immediate disablement of the AI's image-editing features "pending robust safeguards are established".

Cybersecurity Warnings and Legal Definitions

A digital safety expert reinforced concerns about the "tennis game" and the "alarmingly sluggish" government reaction. He cautioned that as artificial intelligence advances, allowing synthetic media to become extended clips, the impact for individuals would intensify.

“It is unbelievable that this is able to occur,” he stated. “We have to move forward with stringent controls. Any grey area we allow will be exploited.”

It is currently a crime to produce or distribute non-consensual intimate images or exploitative content. Synthetic depictions of people in bikinis can be classified as intimate images under the legal definition.

The advocate noted that synthetic images of children in swimsuits might not constitute illegal material but were nevertheless disrespectful toward children's privacy and agency.

“It is unacceptable to live in a society in which a kid is unable to share a picture of an achievement unless they are prepared to be objectified and humiliated,” she said.