In Spain, dozens of girls are reporting AI-generated nude photos of them being circulated at school: ‘My heart skipped a beat’

This was just a matter of time - and there isn't really that much the affected can do (and in some cases, should do). Shutting down that service is the correct thing - but that'll only buy a short amount of time: Training custom models is trivial nowadays, and both the skill and hardware to do so is in reach of the age group in question.

So in the long term we'll see that shift to images generated at home, by kids often too young to be prosecuted - and you won't be able to stop that unless you start outlawing most of AI image generation tools.

At least in Germany the dealing with child/youth pornography got badly botched by incompetent populists in the government - which would send any of those parents to jail for at least a year, if they take possession of one of those generated pictures. Having it sent to their phone and going to police for a complaint would be sufficient to get prosecution against them started.

There's one blessing coming out of that mess, though: For girls who did take pictures, and had them leaked, saying "they're AI generated" is becoming a plausible way out.

At least now you can claim it's AI if your real nudes leak

Interesting. Replika AI, ChatGPT etc crack down on me for doing erotic stories and roleplay text dialogues. And this Clothoff App happily draws child pornography of 14 year olds? Shaking my head...

I wonder why they have no address etc on their website and the app isn't available in any of the proper app-stores.

Obviously police should ask Instagram who blackmails all these girls... Teach them a proper lesson. And then stop this company. Have them fined a few millions for generating and spreading synthetic CP. At least write a letter to their hosting or payment providers.

Yes, lets name the tool in the article so everybody can participate in the abuse

The shock value of a nude picture will become increasingly humdrum as they become more widespread. Nudes will become so common that no one will batt an eye. In fact, some less endowed, less perfect ladies will no doubt do AI generated pictures or movies of themselves to sell on the internet. Think of it as photoshop X 10.

Banning diffusion models doesn't work, the tech is already out there and you can't put it back in the box. Fake nudes used to be done with PhotoShop, the current generative AI models only makes them faster to make.

This can only be stopped on the distribution side, and any new laws should focus on that.

But the silver lining of this whole thing is that nude scandals for celebs aren't really possible any more if you can just say it's probably a deepfake.

The only thing new about this is that the photos are probably more realistic, but still fake. Apps to do this existed before GenAI was a thing

Can this come full circle so I can shirtcock it and later say, "dog, that's AI" when people post pictures?

Maybe something will change as soon as people start creating and distributing fake AI nudes of that country’s leaders.

Permanently Deleted

That's really, really sad, EU, please try to regulate AI.

I tried the AI with a pic of me. It was incredibly inaccurate and gave me something between a dick and a vagina. Nothing truly damaging.

Better don't stop posting your life into the internet, this would push people to create more child porn! /s

This all would not be a problem if people appreciated nudism more. Im not even talking about people being nudists, just people accepting nudists. Once you take away the nudism taboo, all these photos won't matter at all

So, how close to the real bodies are the fakes?

Why are men?

This seems like a pretty significant overreaction. Like yes, it’s gross and it feels personal, but it’s not like any of the subjects were willing participants…their reputation is not being damaged. Would they lose their shit about a kid gluing a cut out of their crush’s face over the face of a pornstar in a magazine? Is this really any different from that?

Reason #48373884 why generative AI should be banned

Permanently Deleted

Governments need to strike hard against all kinds of platforms like this, even if they can be used for legitimate reasons.

AI is way too dangerous a tool to allow free innovation and market on, it's the number one technology right now that must be heavily regulated.