The increasing sophistication of AI-generated photos raises concerns about the reliability of visual evidence
Cosmic Cleric
link
fedilink
English
107M

From the article…

The real danger lies in those images that are crafted with the explicit intention of deceiving people — the ones that are so convincingly realistic that they could easily pass for authentic historical photographs.

Fundamentally/meta level, the issue is one of is; are people allowed to deceive other people by using AI to do so?

Should all realistic AI generated things be labeled as such?

It was ever thus:

A lie gets halfway around the world before the truth has a chance to get its pants on.

Winston Churchill

“The truth may be out there, but lies are inside your head.” – Terry Pratchett

I don’t dare to ask why your truth has been naked before…

@voracitude@lemmy.world
link
fedilink
English
87M

Because the truth fucks, homie.

hamid
link
fedilink
English
137M

The past we know is a carefully crafted and curated story and not at all accurate as it is. It is valuable to learn and understand but also be skeptical. I don’t really think wide spread forgery changes that. Historiography is a very important field.

Any serious historical research will have to verify the physical copies exist or existed in a documented way to be admitted as evidence. This is called chain of custody and is already required.

Can AI write car service manuals that are only slightly incorrect?

AI is creating fake XY, and that is problems, problems, problems everywhere…

During the last decades, IT guys and scientists have always dreamed about using AI for good things. But now AI has become so much better at creating fake things than good things :-(

@Carrolade@lemmy.world
link
fedilink
English
-47M

It’s not really a new problem, people were doing it with their imaginations and stories long before AI came around. The tools of the digital age simply amplified the effect. Healthy skepticism is still the solution, that hasn’t changed.

It’ll never actually go away, though. Of all the possibile ways of looking at any given situation, the vast majority will always be inaccurate. Fiction simply outnumbers nonfiction. Wrong answers outnumber correct answers.

So, the adjustment has to be inside of us, and again, it’s always been necessary. This isn’t fundamentally new.

@uienia@lemmy.world
link
fedilink
English
6
edit-2
7M

The new thing is the scope in which fake content is being created. In a very near future most internet content will be fake, including history. That is not something that has happened before in history.

The current AI situation is completely unprecedented in history.

@djnattyp@lemmy.world
link
fedilink
English
17M

I mean, maybe it has happened before in history, but someone changed it via AI and we just don’t know…

@Carrolade@lemmy.world
link
fedilink
English
47M

I would disagree. I think if we go back even a few centuries, we find that virtually nobody had a firm grasp on historical fact, due to the printing press not being invented yet, alongside archeological techniques not existing.

@nivenkos@lemmy.world
link
fedilink
English
77M

People created fake photoshop images long before AI…

@Buffalox@lemmy.world
link
fedilink
English
347M

And trust me, these generated images are getting scarily good.

I have to agree, I would not be able to spot a single one of them as fake. They look really convincingly authentic IMO.

Flying Squid
creator
link
fedilink
English
757M

Stalin famously ordered people he had killed erased from photos.

Imagine what current and future autocratic regimes will be able to achieve when they want to rewrite their histories.

Like 1984.

Cosmic Cleric
link
fedilink
English
1
edit-2
7M

Honestly, it looks like the picture on the left is fake, like the guy was inserted into it. Just look at his outline, compared with the rest of the background.

(I’m no Stalin fan, just commenting on the picture itself.)

@Buffalox@lemmy.world
link
fedilink
English
30
edit-2
7M

Stalin famously ordered people he had killed erased from photos.

This checks out, here’s an article about it: https://www.history.com/news/josef-stalin-great-purge-photo-retouching

So why are you downvoted? Maybe because your view is too optimistic? And the problem isn’t only with autocratic regimes. But much more general.
How do we validate anything, when everything can be easily faked?

“Photoshopping” something bad existed for a long time at this point.AI generated images doesn’t really change anything other then the entire photo being fake instead of just a small section.

Flying Squid
creator
link
fedilink
English
37M

It changes a lot. Good Photoshopping skills would not create the images as shown in the article.

@uienia@lemmy.world
link
fedilink
English
17M

The easy and speed with which AI created photos, of a quality most photoshoppers could only dream, can be created of does very much change everything.

@Carrolade@lemmy.world
link
fedilink
English
147M

Probably just because some people really like Stalin, and have become convinced his accounts are the truthful ones and everyone else lies about him.

@Buffalox@lemmy.world
link
fedilink
English
37M

That’s a scary thought!! But all kinds of crazy exist, and I mean people have to be literally crazy to want to live under a regime like Stalin made.

@profdc9@lemmy.world
link
fedilink
English
177M

We’ll now need AIs to spot AI fakes. AI wins!

Flying Squid
creator
link
fedilink
English
197M

The problem is that it’s a constant war between fake generators and fake detection algorithms. Sort of a digital version of bacteria out-evolving antibiotics.

https://www.theverge.com/2019/6/27/18715235/deepfake-detection-ai-algorithms-accuracy-will-they-ever-work

@hansl@lemmy.world
link
fedilink
English
-17M

Check out Adobe’s Content Authentication Initiative. It won’t prevent those images but it will allow you to verify their source, which in this case should not authenticate.

@sunbytes@lemmy.world
link
fedilink
English
12
edit-2
7M

And for a reasonable price, the AI corporations will sell you the chance to survive in the world they created for you.

@Gakomi@lemmy.world
link
fedilink
English
07M

Does that AI think that Indian people are monkeys or something case there is a photo there where it clearly made their face look more inline with a monkey

@Rolando@lemmy.world
link
fedilink
English
67M

Compare to the “Cottingley Fairies” photographs of 1917.

plz1
link
fedilink
English
27M

I just listened to the Criminal podcast on that, recently. Fascinating cultural moment.

Optional
link
fedilink
English
117M

So AI really is a seminal paradigm-changing technology. For the worse.

Cosmic Cleric
link
fedilink
English
17M

For the worse.

Not necessarily.

But we’re going to have to deal with the basic issue of deceiving someone with AI, and if any AI generated thing should be labeled or not as such.

Basically, a legislative fix, and not just a free market free for all.

How do you enforce labelling when there will never be a way to reliably test if something was ai generated?

Basic is not a word that fits the situation.

Cosmic Cleric
link
fedilink
English
07M

How do you enforce labelling when there will never be a way to reliably test if something was ai generated?

If the icon is not there and then it’s determined that it’s AI generated, as it was with that British royal family picture the other day; crowd sourced.

I am not understanding you. Or perhaps you’re not understanding me.

Firstly, the British royal family photo was not ai generated.

If you can’t find a way to test if something is ai generated, who decides what is or isn’t ai generated?

TurtleJoe
link
fedilink
English
127M

Automatic spam generator.

When I read the title I sarcastically thought “Oh no, why is AI deciding to create fake historical photos? Is this the first stage of the robot apocalypse?” I find the title mildly annoying because it putting the blame on the tool and ignoring that people are using it to do bad things. I find a lot of discussions about AI do this. It is like people want to avoid that it is how people are using and training the tool is the issue.

Flying Squid
creator
link
fedilink
English
-27M

Isn’t the tool part of the issue? If you sell bomb-making parts to someone who then blows up a preschool with them, aren’t you in some way culpable for giving them the tool to do it? Even if you only intended it to be used in limestone quarries?

@Grimy@lemmy.world
link
fedilink
English
27M

Everything needed to make a bomb can be found at your local Walmart. Nobody blames the gas companies when something gets molotoved.

@WhatAmLemmy@lemmy.world
link
fedilink
English
7
edit-2
7M

That really depends on whether the bomb making part is specific to bombs, and if their purchase of that item could be considered legitimately suspicious. Many over the counter products have the potential to be turned into bombs with enough time or effort.

If a murderer uses a hammer, do you think the hardware store they purchased the hammer from should be liable?

You can make crude chemical weapons by mixing bleach with other household items. Should the supermarket be liable for people who use their products in ways they never intended?

@kromem@lemmy.world
link
fedilink
English
17M

Exactly this, many times over.

Most tools with legitimate uses also have unethical uses.

Create a post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


  • 1 user online
  • 175 users / day
  • 576 users / week
  • 1.37K users / month
  • 4.48K users / 6 months
  • 1 subscriber
  • 7.41K Posts
  • 84.7K Comments
  • Modlog