Some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies.

Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

@Wispy2891@lemmy.world
link
fedilink
English
66M

Something that can also happen: require Facebook login with some excuse, then blackmail the creeps by telling “pay us this extortion or we’re going to send proof of your creepiness to your contacts”

youtube has been for like 6 or 7 months. even with famous people in the ads. I remember one for a while with Ortega

Ortega? The taco sauce?

NSFW-ish

I sat down with tacos as I opened up that reply.

Witch.

@Shadywack@lemmy.world
link
fedilink
English
26M

So, if the AI generated tits look real, but they’re not HER tits, is it just less terrible?

AI gives creative license to anyone who can communicate their desires well enough. Every great advancement in the media age has been pushed in one way or another with porn, so why would this be different?

I think if a person wants visual “material,” so be it. They’re doing it with their imagination anyway.

Now, generating fake media of someone for profit or malice, that should get punishment. There’s going to be a lot of news cycles with some creative perversion and horrible outcomes intertwined.

I’m just hoping I can communicate the danger of some of the social media platforms to my children well enough. That’s where the most damage is done with the kind of stuff.

@abhibeckert@lemmy.world
link
fedilink
English
19
edit-2
6M

The porn industry is, in fact, extremely hostile to AI image generation. How can anyone make money off porn if users simply create their own?

Also I wouldn’t be surprised if the it’s false advertising and in clicking the ad will in fact just take you to a webpage with more ads, and a link from there to more ads, and more ads, and so on until eventually users either give up (and hopefully click on an ad).

Whatever’s going on, the ad is clearly a violation of instagram’s advertising terms.

I’m just hoping I can communicate the danger of some of the social media platforms to my children well enough. That’s where the most damage is done with the kind of stuff.

It’s just not your children you need to communicate it to. It’s all the other children they interact with. For example I know a young girl (not even a teenager yet) who is being bullied on social media lately - the fact she doesn’t use social media herself doesn’t stop other people from saying nasty things about her in public (and who knows, maybe they’re even sharing AI generated CSAM based on photos they’ve taken of her at school).

@stewie3128@lemmy.ml
link
fedilink
English
16M

I think old people are the ones less likely to understand this stuff.

@Nobody@lemmy.world
link
fedilink
English
746M

It’s all so incredibly gross. Using “AI” to undress someone you know is extremely fucked up. Please don’t do that.

???
link
fedilink
English
-36M

removed by mod

@mriormro@lemmy.world
link
fedilink
English
13
edit-2
6M

This is also fucking creepy. Don’t do this.

???
link
fedilink
English
-1
edit-2
6M

removed by mod

I’m going to undress Nobody. And give them sexy tentacles.

@Nobody@lemmy.world
link
fedilink
English
46M

Behold my meaty, majestic tentacles. This better not awaken anything in me…

@BreakDecks@lemmy.ml
link
fedilink
English
13
edit-2
6M

deleted by creator

Noble Shift
link
fedilink
English
76M

deleted by creator

@Jarix@lemmy.world
link
fedilink
English
16M

My only hope is it also reduces CSAM of real people. Please at least do that much!

Noble Shift
link
fedilink
English
26M

deleted by creator

@Jarix@lemmy.world
link
fedilink
English
26M

What the fuck do you mean no?! This is happening right the fuck now. Its already happening. You DONT want it to decrease the total number actual real children who are used and abused to feed this shit?

I think you think im supporting this in some way. I AM NOT. Im saying i hope that any of the pedos out there are using this instead of taking action against actual children will not have already harmed children or at the very least reduce the total harm done.

Christ what the hell are we coming to if we cant even try to find some fucking sanity in this situation.

And for all that is good and right in the world i also very much hope it doesnt lead to MORE abuse.

Can we at least hope for the best while trying to fix the worst?

@BreakDecks@lemmy.ml
link
fedilink
English
1
edit-2
6M

deleted by creator

@Jarix@lemmy.world
link
fedilink
English
1
edit-2
6M

Look we dont know for sure. Im grasping at silver linings made of straws. I dont care how unlikely it is to be true, but there is a chance.

A chance that some day, months years or decades, we will find out whether or not it didnt work out in best way it could have given whats already happening. But we will get an answer that will be pretty hard to disagree with

And i wont be surpised when it isnt what im hoping it might be. I wont be devastated or have my world view shattered.

Im not naive, im just hoping that we are wrong. Even if is a bit rediculous and theres only evidence to the contrary along the way.

What we know today may not be what we understand next year

Truth is stranger than fiction. We have soo many problems now its fine if we WANT an easy win we wont be able to KNOW the answer to for AN amount of time yet. But only if we are honest with ourselves that just because we want something, doesnt mean its has to happen. I also know that today

But holy hell my guy im fucking grasping that straw. This shit is too bleak and we need something to keep us from taking vigilant action. What we dont need is to stir the pot of fear worry and horror before its time to take action.

If we cant see paths to better places we will have one hell of a hard time recognizing things that will help us get to that path. And if you dont agree we need a new path, it might be too late for you

Hello Hotel
link
fedilink
English
5
edit-2
6M

The idea that the children in this photo are ment to be seen in the same context of a porn site (or at least somthing using the pornhub logo likeness) is discusting.

DISCLAIMER: Ive havent gone throught this myself but know what porn adiction feels like. its not fun and will warp who you are on the inside.

Anyone lured for any reason to this site, DO NOT ENGUAGE it WILL HURT YOU! If for whatever reason theve put their hooks in you and are reeling you in, Use stratigies that Alcoholics Anonimous use. LITERALLY ANYTHING is better than using pictures of REAL CHILDREN for sexual grtification.

That makes me sick!! 😠

Google Play and co are allowing similar apps

@eran_morad@lemmy.world
link
fedilink
English
46M

Shit ain’t right.

Good, let all celebs come together and sue zuck into the ground

Its funny how many people leapt to the defense of Title V of the Telecommunications Act of 1996 Section 230 liability protection, as this helps shield social media firms from assuming liability for shit like this.

Sort of the Heads-I-Win / Tails-You-Lose nature of modern business-friendly legislation and courts.

Can you link some of these nudificator apps? Just for research 🤭

Go on Instagram. Like four photos of girls in bikinis. The ad tool will figure out what you want shortly.

@Emerald@lemmy.world
link
fedilink
English
26M

I want to put photos of non-humans in there genuinely. I wonder what it would do to a photo of a brick or a giraffe.

New confused boners community me thinks.

Or the furrys get a little weirder

@Emerald@lemmy.world
link
fedilink
English
16M

Nah it won’t do that because the ai is human-only. Unless it has some secret beastiality DLC I don’t know about.

Plz don look at my digital pp, it make me sad… Maybe others have different feeds but the IG ad feed I know and love promotes counterfeit USD, MDMA, mushrooms, mail order brides, MLM schemes, gun building kits and all kinds of cool shit (all scams through telegram)…so why would they care about an AI image generator that puts digital nipples and cocks on people. Does that mean I can put a cock on Hilary and bobs/vagenes on trump? asking for a friend.

@Sami_Uso@lemmy.world
link
fedilink
English
96M

Capitalism works! It breeds innovation like this! good luck getting non consensual ai porn in your socialist government

This reminded me of those kid’s who made pornographic so videos of their classmates.

Create a post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


  • 1 user online
  • 182 users / day
  • 580 users / week
  • 1.37K users / month
  • 4.49K users / 6 months
  • 1 subscriber
  • 7.41K Posts
  • 84.7K Comments
  • Modlog