Digital Child Abuse and the Rising Threat of AI Exploitation

Digital Child Abuse and the Rising Threat of AI Exploitation

Why in News?

The UK’s Department for Science, Innovation and Technology, along with the AI Safety Institute, released the first-ever International AI Safety Report 2025 (updated in February). The report warns of a critical emerging threat: the generation and distribution of Child Sexual Abuse Material (CSAM) using AI tools. The United Kingdom is now leading the charge globally to address AI-driven CSAM through progressive legislation. The article emphasizes the need for India to amend its existing legal framework to tackle this new threat effectively.

Introduction

Artificial Intelligence has evolved to generate hyper-realistic images and videos, including those involving children. This has given rise to a deeply disturbing phenomenon: AI-generated CSAM. These materials are increasingly found on the open web, with reports from the Internet Watch Foundation (2024), the World Economic Forum (2023), and UK and Indian authorities highlighting the dangers.

India must act fast and decisively to address this threat to children’s dignity, safety, and mental health.

Recent Developments

The new UK legislation aims to:

• Make it illegal to possess, create, or distribute AI-generated CSAM.

• Penalize pedophile motives behind the use of AI tools.

• Shift the legal approach from accused-centric to tool-centric, focusing on the means (AI tools) rather than just the actor.

This law would:

1. Ban even the use of AI tools to generate CSAM.

2. Allow authorities to intervene early in the abuse process.

3. Address mental health impacts on children.

4. Include AI-generated images under the legal definition of CSAM.

On Whether India is Future-Ready

According to the National Crime Records Bureau (NCRB) report 2022:

• Cybercrimes against children have drastically increased.

• 1.94 lakh child pornography cases were reported as of April 2024.

• 69,045 cyber tip-line reports were shared with states and UTs (as of March 2024) via the partnership with the US-based National Center for Missing and Exploited Children (NCMEC).

Currently, India uses Section 67B of the IT Act 2000 to punish electronic transmission of CSAM. The POCSO Act 2012 (Sections 13–15) criminalizes using children for pornography and gratification, but lacks tools to tackle AI-generated CSAM.

A Plan to Follow

India’s legal framework must be updated to tackle modern threats:

1. Broaden the definition of CSAM under the POCSO Act to include AI-generated content.

2. Redefine “sexually explicit” under Section 67B of the IT Act to account for digital fabrication.

3. Include Virtual Private Networks (VPNs) and cloud services as part of the legal liability chain.

4. Pass statutory amendments to reflect modern technologies.

5. Adopt the UN Draft Convention on countering misuse of AI for criminal purposes.

6. Replace the outdated IT Act 2000 with the proposed Digital India Act 2023, which is currently under review.

Conclusion

AI-generated child sexual abuse material represents a dangerous fusion of technology and criminal intent. Countries like the UK are paving the way with forward-thinking laws that India must learn from. A comprehensive, modern, and adaptive legal framework is urgently needed to protect India’s children from this new age of exploitation. AI may be advancing rapidly, but the law must keep pace—if not stay one step ahead.

5 Q&A: Understanding the Threat of AI-Generated CSAM

Q1. What is AI-generated CSAM?
AI-generated CSAM refers to digital images, videos, or audio that depict child sexual abuse using artificial intelligence tools—often fabricated but disturbingly realistic.

Q2. Why is this more dangerous than traditional CSAM?
Because it can be created without involving a real child, making it harder to trace and easier to distribute at scale while still inflicting psychological harm and normalizing abuse.

Q3. How is the UK addressing this issue?
The UK is introducing legislation that criminalizes the use, possession, or distribution of CSAM generated by AI tools, making it a proactive and tool-centric legal model.

Q4. What are the gaps in India’s current laws?
India’s laws like POCSO Act and IT Act are not equipped to handle AI-generated content, as they rely on the depiction of real children and don’t include AI tools or digital intermediaries like VPNs.

Q5. What can India do to improve?
India should amend key definitions in existing laws, update the IT Act through the Digital India Act 2023, and adopt international frameworks like the UN Convention on AI misuse.