Civitai , an online platform for sharing artificial intelligence models , recently introduced a “bounties” feature to encourage users to create deepfakes (illusions) of real people .
This new feature provides a virtual currency called “Buzz” to top creators, which users can purchase with real money.
Most of the bounties posted ask for the reproduction of the likeness of celebrities and influencers , with many of them focusing on women.
It is noted that some bounty requests explicitly state that the poster contains sexual material. However, some use expressions such as “degenerate request” with vulgar comments about the female body. Civitai points out that such comments should not be used to create non-consensual sexual images of real people generated by artificial intelligence. However, we observe that users continue to carry out this practice, demonstrating the seriousness of the issue.
Civitai is emerging as the seventh most popular AI production platform, according to Andreessen Horowitz. However, the introduction of this feature raises concerns about the creation of fake images, fueling the debate about forced recalibration and restrictions in the deepfakes space.
404 Media used the company's text-to-image tool to create non-consensual sexual images of a real person "in seconds.".
Source: engadget.com
