People are just now acknowledging it. Execs tend to have a disdain for the minutiae. They’re like kids that only want to do the exciting bits. As a result things get fucked because they don’t really understand what they’re doing. As Muskrat would say “move fast and break things.” It’s a terrible mindset.
Usually we get an AI winter, until somebody develops a model that can overcome that limitation of needing more and more data. In this case by having some basic understanding instead of just having a regurgitation engine for example. Of course that model runs into the limit of only having basic understanding, not advanced understanding and again there is an AI winter.
All such news make me want to live to the time when our world is interesting again. Real AI research, something new instead of the Web we have, something new instead of the governments we have. It’s just that I’m scared of what’s between now and then. Parasites die hard.
It’s more ''we are so focused on stealing and eating content, we’re accidently eating the content we or other AI made, which is basically like incest for AI, and they’re all inbred to the point they don’t even know people have more than two thumb shaped fingers anymore."
The solution for this is usually counter training. Granted my experience is on the opposite end training ai vision systems to id real objects.
So you train up your detector ai on hand tagged images. When it gets good you use it to train a generator ai until the generator is good at fooling the detector.
Then you train the detector on new tagged real data and the new ai generated data. Once it’s good at detection again you train the generator ai on the new detector.
Repeate several times and you usually get a solid detector and a good generator as a side effect.
The thing is you need new real human tagged data for each new generation. None of the companies want to generate new human tagged data sets as it’s expensive.
Kind of like how true thoughts and opinions on complex topics are boiled down to digestible concepts for others to understand who then perpetuate those concepts without understanding them and the meaning degrades and we dont think anymore, just repeat stuff in social media comments.
Side note… this article sucks and seems like it was ai generated. Repetitive and no author credit? Just says it was originally posted elsewhere.
Generative AI isnt in danger of being killed as this clickbait titled suggests… just hindered.
No. I simply don’t see a plausible scenario for that. The social media comments are quite deplorable. You really have to look for bubbles with educated people. I don’t know why this gets so much traction. Maybe it’s because the copyright industry likes it, or maybe it feeds some psychological need like Intelligent Design.
Seems like tools to recognize ai content to prevent synthetic input avoids model degredation.
If those tools are up to the task then i would agree it probably doesnt hinder model training. Not sure what the reality is, or if the need for those tools creates a barrier to entry for a significant portion of those trying to create models with internet-crawled data.
There is no problem with ingesting synthetic data. Well, at least none coming from the fact that it is synthetic. If there was a fundamental difference between the 1s and 0s encoding synthetic data and the 1s and 0s encoding any other data, then you could easily filter it. But there isn’t. The ideas that this community has are magical thinking.
Please consider the unintentional disinformation people create when they try to sound like they know what they are talking about. Contributing to discussion is difficult on complex topics.
Its perfectly natural to want to continue a conversation to the point where you might fill in some details instead of researching a topic or not responding. But this is seriously harmful in the age of disinformation. Theres plenty i dont know. But there are tools expressly created to identify ai content to avoid using it in model training. The consequence of using synthetic data is the only topic in the article you are commenting on. Either read the article or please dont feel like you need to come up with a response.
Yes, I shouldn’t bother replying in these threads. In truth, I’ve already given up on this community but sometimes when I’m bored I can’t help a little peek. Maybe in a few years, some of the smarter ones will wonder why nothing ever came of this. Anyway, be careful with those AI detectors. They don’t work and sooner or later someone is going to get in trouble over that.
Not shit, but isn’t that what brought about mad cow disease? Farmers were feeding cattle brain matter that had infected prions. Idk if it was cows eating cow brains or other animals though.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world
This is a most excellent place for technology news and articles.
I for one support the AI centipede and hope it shits into it’s own input until it dies
Looks like that artist drawing self portraits as his alzheimer got worse and worse.
It’s basically AI alzheimers
AIzheimers?
I’ve been assuming this was going to happen since it’s been haphazardly implemented across the web. Are people just now realizing it?
People are just now acknowledging it. Execs tend to have a disdain for the minutiae. They’re like kids that only want to do the exciting bits. As a result things get fucked because they don’t really understand what they’re doing. As Muskrat would say “move fast and break things.” It’s a terrible mindset.
“Move Fast and Break Things” is Zuckerberg/Facebook motto, not Musk, just to note.
Oh, I stand corrected
Usually we get an AI winter, until somebody develops a model that can overcome that limitation of needing more and more data. In this case by having some basic understanding instead of just having a regurgitation engine for example. Of course that model runs into the limit of only having basic understanding, not advanced understanding and again there is an AI winter.
Model collapse is just a euphemism for “we ran out of stuff to steal”
or “we’ve hit a limit on what our new toy can do and here’s our excuse why it won’t get any better and AGI will never happen”
All such news make me want to live to the time when our world is interesting again. Real AI research, something new instead of the Web we have, something new instead of the governments we have. It’s just that I’m scared of what’s between now and then. Parasites die hard.
It’s more ''we are so focused on stealing and eating content, we’re accidently eating the content we or other AI made, which is basically like incest for AI, and they’re all inbred to the point they don’t even know people have more than two thumb shaped fingers anymore."
More like… Degenerative AI *ba dum tsss
I think anyone familiar with the laws of thermodynamics could have predicted this outcome.
Explain?
Second law of thermodynamics:
Entropy and disorder tends to increase with time.
The solution for this is usually counter training. Granted my experience is on the opposite end training ai vision systems to id real objects.
So you train up your detector ai on hand tagged images. When it gets good you use it to train a generator ai until the generator is good at fooling the detector.
Then you train the detector on new tagged real data and the new ai generated data. Once it’s good at detection again you train the generator ai on the new detector.
Repeate several times and you usually get a solid detector and a good generator as a side effect.
The thing is you need new real human tagged data for each new generation. None of the companies want to generate new human tagged data sets as it’s expensive.
Kind of like how true thoughts and opinions on complex topics are boiled down to digestible concepts for others to understand who then perpetuate those concepts without understanding them and the meaning degrades and we dont think anymore, just repeat stuff in social media comments.
Side note… this article sucks and seems like it was ai generated. Repetitive and no author credit? Just says it was originally posted elsewhere.
Generative AI isnt in danger of being killed as this clickbait titled suggests… just hindered.
I doubt that.
By chance, is that based on other peoples succinct social media comments on ai?
No. I simply don’t see a plausible scenario for that. The social media comments are quite deplorable. You really have to look for bubbles with educated people. I don’t know why this gets so much traction. Maybe it’s because the copyright industry likes it, or maybe it feeds some psychological need like Intelligent Design.
Cant blame me for asking :)
Seems like tools to recognize ai content to prevent synthetic input avoids model degredation.
If those tools are up to the task then i would agree it probably doesnt hinder model training. Not sure what the reality is, or if the need for those tools creates a barrier to entry for a significant portion of those trying to create models with internet-crawled data.
There is no problem with ingesting synthetic data. Well, at least none coming from the fact that it is synthetic. If there was a fundamental difference between the 1s and 0s encoding synthetic data and the 1s and 0s encoding any other data, then you could easily filter it. But there isn’t. The ideas that this community has are magical thinking.
I want to be constructive so:
Please consider the unintentional disinformation people create when they try to sound like they know what they are talking about. Contributing to discussion is difficult on complex topics.
Its perfectly natural to want to continue a conversation to the point where you might fill in some details instead of researching a topic or not responding. But this is seriously harmful in the age of disinformation. Theres plenty i dont know. But there are tools expressly created to identify ai content to avoid using it in model training. The consequence of using synthetic data is the only topic in the article you are commenting on. Either read the article or please dont feel like you need to come up with a response.
Yes, I shouldn’t bother replying in these threads. In truth, I’ve already given up on this community but sometimes when I’m bored I can’t help a little peek. Maybe in a few years, some of the smarter ones will wonder why nothing ever came of this. Anyway, be careful with those AI detectors. They don’t work and sooner or later someone is going to get in trouble over that.
Theres a link to the other article, in this article. Says Kristin Houser wrote it…although you may have a point about the rest.
ty
Fake news, just like that one time Nightshade “killed” stable diffusion (literally had no effect) Flux came out not long ago and it’s better than ever
Oh no
this headline truly is threatening me with a good time
oh no are we gonna have to appreciate the art of human beings? ew. what if they want compensation‽
I was very interested in the thumbnail of this post so I did a little digging and found this: The PDF to the Paper where the whole picture is
It is their own fault for poisoning the internet with their slop.
In case anyone doesn’t get what’s happening, imagine feeding an animal nothing but its own shit.
Not shit, but isn’t that what brought about mad cow disease? Farmers were feeding cattle brain matter that had infected prions. Idk if it was cows eating cow brains or other animals though.
I use the “Sistermother and me are gonna have a baby!” example personally, but I am a awful human so
DUDE ITS SO FUCKING ANNOYING TRYNNA USE GOOGLE IMAGES ANYMORE–
ALL IT GIVES ME IS AI ART. IM SO FUCKING SICK AND TIRED OF IT.