AI tools used to generate child abuse images made illegal in 'world leading' move

AI tools designed to generate child sex abuse material (CSAM) will be made illegal under "world leading" legislation, the government has announced.

The crackdown will also target anyone who possess AI "paedophile manuals" which teach people how to use AI to sexually abuse children.

It comes after warnings AI-generated child abuse imagery is being produced at a "chiling rate" and is "disturbingly realistic".

It is already illegal to possess AI-generated CSAM but the new laws will target the means of production.

This includes:

• Making it illegal to possess, create or distribute AI tools designed to generate CSAM, punishable by up to five years in prison.
• Making it illegal for anyone to possess AI "paedophile manuals" which teach people how to use AI to sexually abuse children, punishable by up to three years in prison.

Jess Phillips, the safeguarding minister, said Britain is the "first country in the world" to legislate for AI abuse imagery.

She said: "This is a global problem and is going to need global solutions. This government is leading the way on trying to clamp down on this horrendous crime."

The Home Office said AI tools are being used to generate abuse images in a number of ways, including by "nudeifying" real-life images of children or by stitching the faces of other children onto existing child sexual abuse images.

The NSPCC said its childline service has been hearing from distressed children who have found AI-generated images of them.

In one call, a 15-year-old girl told them: "A stranger online has made fake nudes of me. It looks so real, it's my face and my room in the background. They must have taken the pictures from my Instagram and edited them. I'm so scared they will send them to my parents. The pictures are really convincing, and I don't think they'd believe me that they're fake."

Perpetrators are also using the fake images to blackmail children and force victims into further abuse, including streaming live images.

The perpetrators can use AI tools to disguise their initial identity and more effectively groom and abuse children online, the Home Office said.

Ms Phillips said: "It is a massive battle. This is where it starts. This is not where it ends."

The government has also announced that it will introduce a specific offence for predators who run websites designed for other paedophiles to share child sexual abuse content or advice on how to groom children, punishable by up to 10 years in prison.

This is already illegal under possession and distribution laws, but the new offence will allow for longer sentences and prevent moderators from trying to claim they don't know what is on the site.

The UK Border Force will also be given new powers to force an individual who they suspect poses a sexual risk to children to unlock their digital devices for inspection.

Read more:
Microsoft hit as AI spending in sharp focus after DeepSeek market shock
UK to 'mainline AI in the veins' under new plans from Sir Keir Starmer

All four measures will be introduced as part of the Crime and Policing Bill when it comes to parliament.

Home Secretary Yvette Cooper said: "We know that sick predators' activities online often lead to them carrying out the most horrific abuse in person. This government will not hesitate to act to ensure the safety of children online by ensuring our laws keep pace with the latest threats."

This comes after The Internet Watch Foundation (IWF) warned of an increase in AI-generated sex abuse images.

Over a 30-day period in 2024, IWF analysts identified 3,512 AI CSAM images on a single dark web site.

Compared with their 2023 analysis, the prevalence of category A images (the most severe category) had risen by 10%.

The IWF also warned that some AI images were so realistic it was hard to distinguish them from real abuse.

Derek Ray-Hill, the charity's interim chief executive, said: "We have long been calling for the law to be tightened up, and are pleased the government has adopted our recommendations. These steps will have a concrete impact on online safety."