Tech companies and UK child safety agencies to test AI tools’ ability to create abuse images

The UK has enacted a new law that allows tech companies and child protection agencies to assess the capabilities of artificial intelligence tools in generating child abuse images. This legislative move is a direct response to alarming statistics indicating that reports of AI-generated child sexual abuse material have surged, increasing from 199 cases in 2024 to 426 in 2025. The significant rise in reported incidents underscores the urgent need for effective oversight and regulation of AI technologies. By enabling testing of these tools, the UK aims to implement necessary safeguards to prevent the misuse of AI in creating harmful content. This initiative reflects a growing recognition of the potential risks posed by AI advancements and the importance of proactive measures to protect vulnerable populations, particularly children, from exploitation.