AI platform introduces 'bounty' system for AI models of real people, targeting not only celebrities but also ordinary people with few followers
In recent years, improvements in the performance and ease of use of image-generating AI have made it easier for many people to create their favorite images using AI. However, this has also led to a problem with the creation and sharing of 'AI-generated images' without the consent of real people. Meanwhile, technology media outlet 404 Media reported that
Giant AI Platform Introduces 'Bounties' for Deepfakes of Real People
https://www.404media.co/giant-ai-platform-introduces-bounties-for-nonconsensual-images-of-real-people/
Civitai is a platform where users can post and share various AI-generated images, including the prompts, model data, and LoRA files used to generate the images. It has also been reported that model data specifically designed to generate adult content is gaining popularity.
Adult content generation using image generation AI is becoming outrageous, with 'free distribution of models trained on pornography' and 'paid services that can easily generate pornographic images' - GIGAZINE
Civitai has introduced a system that allows users to offer 'bounties' for the creation of AI models that generate images of real people, with virtual currency being paid to the AI model creators. 404 Media stated, 'Since the feature's launch, many of the bounties on Civitai have focused on recreating photos of celebrities and social media influencers. However, 404 Media has confirmed that at least one bounty has been paid for an AI model created by an individual who does not have a significant online presence.'
Michelle Alves , an Instagram influencer who is actually receiving a bounty on Civitai, said, 'I've been facing issues with my image being misused for years, but this kind of thing never crossed my mind. The internet seems like an uncontrollable place, so I don't know what measures I can take. The only thing I can think about is what kind of mental impact this will have.'
The bounty offer from a member of the public that 404 Media confirmed did not include a person's name, but did include several images taken from social media as source data. After further investigation, 404 Media confirmed that the person in question is not a celebrity or influencer, but rather an ordinary person with a small number of followers. The person did not respond to a request for comment.
The client claimed the woman was his wife, but her Facebook page listed her as single, and other users were not convinced. One user wrote, 'Why share a low-quality screenshot of your wife's profile when you can take a nice photo and use it?' Another user warned, 'If you don't want to be sued for legal issues in the future, you shouldn't create and share her LoRA model.'
However, one user responded to this request and created an AI model, which they received a reward for. The female AI model is publicly available on Civitai and is available for download by any Civitai user, 404 Media reports.
Civitai's 'AI model and image bounty system' formalizes a previous practice of creating AI models of celebrities upon request, which had been privately conducted in the 'Model Request' room of the official Discord channel.
Civitai's reward system uses a proprietary virtual currency called 'Buzz.' Users can earn Buzz by engaging with users through activities such as following other users, posting images, and sharing models, or by purchasing it with real money. Following one user earns 10 Buzz, and users can purchase 1,000 Buzz for $1 (approximately 150 yen). Users can also create an AI model by uploading a photo of a target person's face via the Civitai website for 500 Buzz.
The policy for the bounty system, like other AI-generated content published on Civitai, does not allow 'sexual content without the consent of real people.' However, Civitai has an AI model designed to generate pornographic images and a tool for generating images from text using models published on the site. Therefore, by combining the AI model created through the bounty system with the tool, 404 Media reported that it is easy to create sexual images of real people.
Related Posts:
in AI, Software, Web Service, Posted by log1h_ik