Jul 10, 2024 16:36:00

15 students who created and shared nude images of classmates using AI are given one year of probation

With the development of generative AI, it has become easier to generate nude images (deepfake pornography)

using AI-generated fake images, and harassment caused by deepfake pornography has already become a social problem in countries around the world. In one case in Spain, 15 students were charged with generating and sharing deepfake pornography of their classmates and were sentenced to one year of probation.

Spain sentences 15 schoolchildren over AI-generated naked images | Spain | The Guardian
https://www.theguardian.com/world/article/2024/jul/09/spain-sentences-15-school-children-over-ai-generated-naked-images

The Guardian, a major British daily newspaper, reported on a case involving AI-generated deepfake pornography in the town of Almendralejo in southern Spain in March 2024. The 14-year-old daughter of Miriam Al-Adib, a resident of the town, had deepfake pornographic images of herself created using an AI pornography app called ClothOff, which spread the images for several weeks in a WhatsApp group created by other students.

In addition to Al-Adib's daughter, several other girls had been victims of similar deepfake pornography. Victims had refused to go to school, suffered panic attacks, been blackmailed, and been bullied. Prosecutors were considering prosecuting children involved in the creation and distribution of deepfake pornography.

For more details about this incident, please read the article below.

Who is behind the AI porn app 'ClothOff' that strips clothes from photos of girls being sexually assaulted? - GIGAZINE

Subsequent police investigations revealed that children aged 13 to 15 were involved in the creation and distribution of a series of deepfake pornography. On July 9, the Badajoz Juvenile Court found a total of 15 children guilty of 20 counts of creating child abuse images of minors and 20 counts of crimes against the moral integrity of the victims.

'It was established that the minors obtained the doctored images by using an artificial intelligence application to extract the girls' faces from their social media profiles and superimpose the images onto nude female bodies. The doctored images were then shared in two WhatsApp groups,' the court said in a statement.

The defendants were each given a one-year probationary sentence and required to attend rehabilitation courses on gender equality awareness and the 'responsible use of technology.' Some of the perpetrators were children under the age of 13, who cannot be prosecuted under Spanish law, but these children may also be referred to child protection services and ordered to attend rehabilitation courses.