In Spain, dozens of girls are reporting AI-generated nude photos of them being circulated at school: ‘My heart skipped a beat’

Politics is about to get WILD

To verify if something is real, we might have to rely on witness testimony.

This is not going to work. Just because images and videos become less reliable that doesn't mean we will forget about the fact that eyewitness testimony is very unreliable.

Indeed, once the AI gets good enough, the value of pictures and videos will plummet to zero.

This just isn't true. They will still be used to sexualise people, mostly girls and women, against their consent. It's no different from AI-generated child pornography. It does harm even if no 'real' people appear in the images.

Fucking horrible world we're forced to live in. Where's the fucking exit?

A bit off topic, but I wonder if the entertainment industry as a whole is going to be completely destroyed by AI when it gets good enough.

I can totally see myself prompting “a movie about love in the style of Star Wars, with Ryan Gosling and Audrey Hepburn as the leads, directed by Alfred Hitchcock, written by Vincent Hugo.” And then what? It’s game over for any content creation.

Curious if I’ll see that kind of power at home (using open source tools) in my lifetime.

Not necessarily, solutions can implemented. For example, footage from private security cameras can be sent to trusted establishment (trusted by the court at least) in real time which can be timestamped and stored (maybe not necessarily even stored there, encryption with timestamp may be enough). If source private camera and the network is secure, footage is also secure.

Thats why we need Blockchain Technology..

Check Blockchain Camera for example: https://github.com/sv1sjp/Blockchain_Camera

Abstract:

    

Blockchain Camera provides an easy and safe way to capture and guarantee the existence of videos reducing the impact of modified videos as it can preserve the integrity and validity of videos using Blockchain Technology. Blockchain Camera sends to Ethereum Network the hash of each video and the time the video has been recorded in order to be able validate that a video is genuine and hasn't been modified using a Blockchain Camera Validation Tool.


  

Considering that AI services typically cost money, especially those advertising adult themes, it kinda does do support the hosters of such services.

I can already get a canvas and brush and draw what I think u/DessertStorms looks like naked and there is nothing you can do about it.

Have you ever posted a photo on Facebook or Instagram?

If the answer is yes, congratulations! You gave consent.

The age of the victims is not really relevant. The problem would remain if the article were about adults.

We'll need an AI run police state to stop this technology. I doubt anybody has even the slightest interest in that.

I hope we don't repeat Google Lens Glass

Yeah, but you can still regulate the content. Just because you can find CP on the web, doesn't mean that they shouldn't make it illegal. It deters people from it, and allows police to prosecute.

Obviously this is creepy, but the technology is out there, one of those can't put the genie back in the bottle techs. You can and should look at the people generating the images as creeps, but ultimately we as a society need to learn to not put as much veracity or identity in images now.

With that said where the fuck did this model get its training data for 14 year olds. That sounds like a more serious issue.

It’s not different, it’s all fake, cobbled together from images of other people’s bodies and will show zero authentic details about the subject except what are already known and visible about them.

What the fuck are you talking about? Spreading nude photos of any provenance around at work is definitely an HR violation, and the use of my partner’s face in them (just like pasting their face on a pornstar’s photo) is sexual harassment. Nothing about it being AI generated changes any of that equation except to make it a little more uncanny.

It’s a fad, and how would we deal with you sending your hand drawn pictures around the neighborhood….form a group of concerned moms and raid all of the local art shops to stop the sale of drawing materials?

The genie is out of the bottle. We can shower these types of content with huge attention which will ultimately extend and expand the fad, we can ignore them because they are pointless, or we can try a futile war on AI porn that, like the war on drugs, will ruin a lot of ultimately benign peoples lives in order to crack down on a few legitimately criminal creeps who probably can already be prosecuted according to existing laws.

Why? They didn’t take or share any nudes, and nobody believes they did.

This is only a nightmare if an ignorant adult tells them that it is.

Issue (A) is bad because it’s essentially CSAM and also because it’s attempting to access a view of someone that the subject likely hasn’t permitted the generator to have access to. This is a privacy violation and the ethics around it are questionable at best.

That part is not a privacy violation, the same way someone drawing in a canvas their own impression of what a bank vault looks like on the inside does not constitute a trespassing / violation of privacy of the bank. Unless the AI in question used actual nudes of them as a basis, but then we wouldn't need the extra AI step for this to be a problem, right? Otherwise, I'm rather sure that the actual privacy violation starts at (B).

Ofc, none of that makes it less of a problem, but it does feel to me like it subverts a potential angle for fighting against this.

I appreciate your intentions, but your examples are just not up to the standard needed to treat AI generated nudes any differently than a nude magazine collage with kids’ crushes faces in it.

As uncanny as the nudes might be, they are NOT accurate. People know this and they are going to learn one way or another to adjust their definition of “real”. No character details like moles or their actual skin tone, or anything like this will be accurately portrayed. They have no reason to think “someone has seen their naked body”. Yeah, if someone tells them to worry about it, they will, as any young person will, but why? The bigger the deal we make of it, the worse it is, and the litmus test is, is it bad if we decide to ignore it and teach kids that ai generated nudes have nothing to do with them and that they can safely ignore them, then they do basically zero harm.

How is your test example related to this at all? In the one case, my face and clothed picture is acquired likely with my implied permission from social media and modifications that i did not authorize are added to it and it is then distributed, making me look naked and having no bearing on my person or character (since the ai doesn’t actually know what i look like naked) so no conclusion anyone would draw from it constitutes a disclosure of information about me. The test example constitutes a clear disclosure with provenance to establish the validity of the information, quire a different scenario. It is true that AI chat bots can be jail-broken to release my previous questions which might reveal things about my character that i do not wish to disclose, but that is a different issue and unrelated to these nude generators.

I’m not saying handing these nudes to a kid or blackmailing them is not criminal or harassment, just that the technology and medium should have almost no bearing on how we treat this.

No amount of false equivalencies will make me or anyone else accept something as stupid, dangerous and terrible as generative AI.

It's on you to accept you don't have the right to have a robot think and be creative for you, and that poor girl is one of many reasons why.

AI generated content is usually pretty obvious.

You're not a genie, you're a lazy reprobate.

It's child porn in this case. Regulate it as such. Putting a real child's head onto an AI generated body is sexualizing a child.

Making unauthorized nude images of other people, probably. The service did advertise, "undress anyone".

Maybe it would feel different to you if it was your daughter's fake nudes making their rounds on her classmate's social media