Please ensure Javascript is enabled for purposes of website accessibility

West Bank Town Becomes ‘Big Prison’ as Israel Fences It In

2 days ago

Trump Says He’s Willing to Let Migrant Farm Laborers Stay in US

2 days ago

US Electric Vehicle Tax Breaks Will Expire on Sept. 30

3 days ago

Eyeing Arctic Dominance, Trump Bill Earmarks $8.6 Billion for US Coast Guard Icebreakers

3 days ago

Trump’s Sweeping Tax-Cut and Spending Bill Wins Congressional Approval

3 days ago

Americans Celebrate Their Independence With Record-Breaking Travel Numbers

3 days ago

US Supreme Court to Decide Legality of Transgender School Sports Bans

3 days ago

Nvidia Set to Become the World’s Most Valuable Company in History

3 days ago

Poll: 41% in US ‘Extremely Proud’ to Be American, Near Historic Low

3 days ago
AI-Generated Child Sexual Abuse Images Could Flood the Internet. A Watchdog Is Calling for Action
By admin
Published 2 years ago on
October 25, 2023

Share

Getting your Trinity Audio player ready...

NEW YORK — The already-alarming proliferation of child sexual abuse images on the internet could become much worse if something is not done to put controls on artificial intelligence tools that generate deepfake photos, a watchdog agency warned on Tuesday.

In a written report, the U.K.-based Internet Watch Foundation urges governments and technology providers to act quickly before a flood of AI-generated images of child sexual abuse overwhelms law enforcement investigators and vastly expands the pool of potential victims.

The Current Situation

“We’re not talking about the harm it might do,” said Dan Sexton, the watchdog group’s chief technology officer. “This is happening right now and it needs to be addressed right now.”

In a first-of-its-kind case in South Korea, a man was sentenced in September to 2 1/2 years in prison for using artificial intelligence to create 360 virtual child abuse images, according to the Busan District Court in the country’s southeast.

In some cases, kids are using these tools on each other. At a school in southwestern Spain, police have been investigating teens’ alleged use of a phone app to make their fully dressed schoolmates appear nude in photos.

The Dark Side of AI

The report exposes a dark side of the race to build generative AI systems that enable users to describe in words what they want to produce — from emails to novel artwork or videos — and have the system spit it out.

If it isn’t stopped, the flood of deepfake child sexual abuse images could bog investigators down trying to rescue children who turn out to be virtual characters. Perpetrators could also use the images to groom and coerce new victims.

Sexton said IWF analysts discovered faces of famous children online as well as a “massive demand for the creation of more images of children who’ve already been abused, possibly years ago.”

“They’re taking existing real content and using that to create new content of these victims,” he said. “That is just incredibly shocking.”

The Investigation

Sexton said his charity organization, which is focused on combating online child sexual abuse, first began fielding reports about abusive AI-generated imagery earlier this year. That led to an investigation into forums on the so-called dark web, a part of the internet hosted within an encrypted network and accessible only through tools that provide anonymity.

What IWF analysts found were abusers sharing tips and marveling about how easy it was to turn their home computers into factories for generating sexually explicit images of children of all ages. Some are also trading and attempting to profit off such images that appear increasingly lifelike.

“What we’re starting to see is this explosion of content,” Sexton said.

Call to Action

While the IWF’s report is meant to flag a growing problem more than offer prescriptions, it urges governments to strengthen laws to make it easier to combat AI-generated abuse. It particularly targets the European Union, where there’s a debate over surveillance measures that could automatically scan messaging apps for suspected images of child sexual abuse even if the images are not previously known to law enforcement.

A focus of the group’s work is to prevent previous sex abuse victims from being abused again through the redistribution of their photos.

The report says technology providers could do more to make it harder for the products they’ve built to be used in this way, though it’s complicated by the fact that some of the tools are hard to put back in the bottle.

The Role of Technology Providers

A crop of new AI image-generators was introduced last year and wowed the public with their ability to conjure up whimsical or photorealistic images on command. But most of them are not favored by producers of child sex abuse material because they contain mechanisms to block it.

Technology providers that have closed AI models, with full control over how they’re trained and used — for instance, OpenAI’s image-generator DALL-E — have been more successful at blocking misuse, Sexton said.

By contrast, a tool favored by producers of child sex abuse imagery is the open-source Stable Diffusion, developed by London-based startup Stability AI. When Stable Diffusion burst onto the scene in the summer of 2022, a subset of users quickly learned how to use it to generate nudity and pornography. While most of that material depicted adults, it was often nonconsensual, such as when it was used to create celebrity-inspired nude pictures.

Stability later rolled out new filters that block unsafe and inappropriate content, and a license to use Stability’s software comes with a ban on illegal uses.

In a statement released Tuesday, the company said it “strictly prohibits any misuse for illegal or immoral purposes” across its platforms. “We strongly support law enforcement efforts against those who misuse our products for illegal or nefarious purposes,” the statement reads.

Users can still access older versions of Stable Diffusion, however, which are “overwhelmingly the software of choice … for people creating explicit content involving children,” said David Thiel, chief technologist of the Stanford Internet Observatory, another watchdog group studying the problem.

The Challenge Ahead

The IWF report acknowledges the difficulty of trying to criminalize AI image-generating tools themselves, even those “fine-tuned” to produce abusive material.

“You can’t regulate what people are doing on their computers, in their bedrooms. It’s not possible,” Sexton added. “So how do you get to the point where they can’t use openly available software to create harmful content like this?”

Most AI-generated child sexual abuse images would be considered illegal under existing laws in the U.S., U.K. and elsewhere, but it remains to be seen whether law enforcement has the tools to combat them.

A British police official said the report shows the impact already witnessed by officers working to identify victims.

The Internet Watch Foundation warns of a potential flood of AI-generated child sexual abuse images online.

“We are seeing children groomed, we are seeing perpetrators make their own imagery to their own specifications, we are seeing the production of AI imagery for commercial gain – all of which normalizes the rape and abuse of real children,” said a statement from Ian Critchley, child protection lead for the National Police Chiefs’ Council.

The IWF’s report is timed ahead of a global AI safety gathering next week hosted by the British government that will include high-profile attendees including U.S. Vice President Kamala Harris and tech leaders.

“While this report paints a bleak picture, I am optimistic,” IWF CEO Susie Hargreaves said in a prepared written statement. She said it is important to communicate the realities of the problem to “a wide audience because we need to have discussions about the darker side of this amazing technology.”

RELATED TOPICS:

DON'T MISS

What Are Fresno Real Estate Experts Predicting for 2025 and Beyond?

DON'T MISS

First California EV Mandates Hit Automakers This Year. Most Are Not Even Close

DON'T MISS

How Trump’s ‘Big, Beautiful Bill’ Will Make China Great Again

DON'T MISS

What’s Caitlin Clark Worth to the WNBA? A Lot More Than Her $78,066 Salary.

DON'T MISS

Trump to Sign Tax-Cut and Spending Bill in July 4 Ceremony

DON'T MISS

Madre Fire Spurs Evacuations Across 3 Counties, Grows to More Than 70,000 Acres

DON'T MISS

Clovis, Sanger, Madera, and Bass Lake Will Light the Sky With Fireworks Shows Tonight

DON'T MISS

Oil Dips Ahead of Expected OPEC+ Output Increase

DON'T MISS

613 Killed at Gaza Aid Distribution Sites, Near Humanitarian Covoys, Says UN

DON'T MISS

Fresno County Authorities Investigating Suspicious Death of Transient Man

DON'T MISS

West Bank Town Becomes ‘Big Prison’ as Israel Fences It In

DON'T MISS

Israeli Military Kills 20 in Gaza as Trump Awaits Hamas Reply to Truce Proposal

UP NEXT

What’s Caitlin Clark Worth to the WNBA? A Lot More Than Her $78,066 Salary.

UP NEXT

Trump to Sign Tax-Cut and Spending Bill in July 4 Ceremony

UP NEXT

Madre Fire Spurs Evacuations Across 3 Counties, Grows to More Than 70,000 Acres

UP NEXT

Clovis, Sanger, Madera, and Bass Lake Will Light the Sky With Fireworks Shows Tonight

UP NEXT

Oil Dips Ahead of Expected OPEC+ Output Increase

UP NEXT

613 Killed at Gaza Aid Distribution Sites, Near Humanitarian Covoys, Says UN

UP NEXT

Fresno County Authorities Investigating Suspicious Death of Transient Man

UP NEXT

West Bank Town Becomes ‘Big Prison’ as Israel Fences It In

UP NEXT

Israeli Military Kills 20 in Gaza as Trump Awaits Hamas Reply to Truce Proposal

UP NEXT

Valley Crime Stoppers’ Most Wanted Person of the Day: Rachelle Maria Blanco

Trump Calls Musk’s Formation of New Party “Ridiculous” and Confusing

1 hour ago

Fresno DUI Driver Slams Into CHP Motorcycle, Tow Truck on Highway 99

8 hours ago

Russia Downs 120 Ukrainian Drones Overnight, Defense Ministry Says

8 hours ago

Israel Sends Delegation to Qatar for Gaza Talks Ahead of Netanyahu Trip to US

8 hours ago

San Luis Obispo’s Madre Fire Grows to Nearly 80,000 Acres, 30% Contained

8 hours ago

Musk Announces Forming of ‘America Party’ in Further Break From Trump

8 hours ago

Death Toll From Texas Floods Reaches 59, Including 21 Children

8 hours ago

California’s Politics Drifts Right While New York’s Leans Left

9 hours ago

How Trump’s ‘Big, Beautiful Bill’ Will Make China Great Again

1 day ago

What’s Caitlin Clark Worth to the WNBA? A Lot More Than Her $78,066 Salary.

1 day ago

TikTok Building New Version of App Ahead of Expected US Sale, the Information Reports

TikTok is building a new version of its app for users in the United States ahead of a planned sale of the app to a group of investors, The I...

1 hour ago

A logo is displayed over a door at the U.S. headquarters of the social media company TikTok in Culver City, California, U.S. January 17, 2025. (Reuters File)
1 hour ago

TikTok Building New Version of App Ahead of Expected US Sale, the Information Reports

Boxes of aid are stacked as Gaza Humanitarian Foundation said it has commenced operations to begin distribution of aid, in Rafah, in the southern Gaza Strip, May 26, 2025. (Reuters File)
1 hour ago

Hamas Government Office Rejects US Accusation of Involvement in Gaza Aid Site Attack

A volunteer searches for flood victims after deadly flooding in Kerr County, Texas, U.S., July 6, 2025. REUTERS/Sergio Flores
1 hour ago

Death Toll From Texas Floods Reaches 78, Trump Plans Visit

Tesla CEO and X owner Elon Musk listens as US President-elect Donald Trump speaks during a meeting with House Republicans at the Hyatt Regency hotel in Washington, DC, U.S. on November 13, 2024. (Reuters File)
1 hour ago

Trump Calls Musk’s Formation of New Party “Ridiculous” and Confusing

A 22-year-old suspected DUI driver crashed into a parked CHP motorcycle and tow truck on Highway 99 near Fresno, narrowly missing an officer and bystanders, CHP said Saturday, July 5, 2025. (CHP)
8 hours ago

Fresno DUI Driver Slams Into CHP Motorcycle, Tow Truck on Highway 99

A service member of a drone unit of the 24th Separate Mechanized Brigade named after King Danylo of the Ukrainian Armed Forces controls a heavy combat drone while it flies over positions of Russian troops, amid Russia's attack on Ukraine, in Donetsk Region, Ukraine June 12, 2025. (Reuters File)
8 hours ago

Russia Downs 120 Ukrainian Drones Overnight, Defense Ministry Says

An Israeli tank maneuvers in Gaza, as seen from the Israeli side of the border, July 6, 2025. (Reuters/Amir Cohen)
8 hours ago

Israel Sends Delegation to Qatar for Gaza Talks Ahead of Netanyahu Trip to US

The Madre Fire near New Cuyama has burned nearly 80,000 acres as of Sunday, July 6, 2025, morning, prompting widespread evacuation orders and warnings across three counties. (CalFire)
8 hours ago

San Luis Obispo’s Madre Fire Grows to Nearly 80,000 Acres, 30% Contained

Help continue the work that gets you the news that matters most.

Search

Send this to a friend