Honestly I kinda wish it would give shorter answers unless I ask for a lot of detail. I can use those custom instructions but it’s tedious difficult to tune that properly.
Like if I ask it ‘how to do XYZ in blender’ it gives me a long winded response, when it could have just said ‘Hit Ctrl-Shift-Alt-C’
It would be awesome if someone had been querying it with the same prompt periodically (every day or something), to compare how responses have changed over time.
I guess the best time to have done this would have been when it first released, but perhaps the second best time is now…
My partner is a CompSci teacher and have been training a local llm in her class. As soon as they named their AI it started producing all these weird emotes with every answer, it became super annoying to where it would rather make up stuff than say I don’t know that answer. It was definitely an eye opener for the kids.
Am late to the game here but after reading the article I would agree.
I use it off and on if I am looking up formulas and scripts and find it a great tool for work. It saves a ton of time. It works great and haven’t noticed any change there. Request it to give/write you a specific formula to solve X and it will. It’s a huge time saver.
But I’ve found recently if I am trying to just find information on a subject that I want summarized or something found on the web and explained it will often ‘recommend I check out the company’s website for the latest news or recent developments.’
That last statement was an exact quote I got recently that made me laugh when I went asking for the explanation of how something worked. It was a NO SHIT SHERLOCK moment I had after getting several of these sort of replies.
I mean I har gotten detailed explanations of string theory ages back from ChatGPI and now it’s telling me ‘ummm just go look it up - I can’t right now…m
First it just starts making shit up, then lying about it, now it’s just at the stage where it’s like, “Fuck this shit.” It’s becoming more human by the day.
I feel like the quality has been going down especially when you ask it anything that may hint at anything “immoral” and it starts giving you a whole lecture instead of answering.
Yep, I spent a month refactoring a few thousand lines of code using GPT4 and I felt like I was working with the best senior developer with infinite patience and availability.
I could vaguely describe what I was after and it would identify the established programming patterns and provide examples based on all the code snippets I fed it. It was amazing and a little terrifying what an LLM is capable of. It didn’t write the code for me but it increased my productivity 2 fold… I’m a developer now a getting rusty being 5 years into management rather than delivering functional code, so just having that copilot was invaluable.
Then one day it just stopped. It lost all context for my project. I asked what it thought what we were working on and it replied with something to do with TCP relays instead of my little Lua pet project dealing with music sequencing and MIDI processing… not even close to the fucking ballpark’s overflow lot.
It’s like my trusty senior developer got smashed in the head with a brick. And as described, would just give me nonsense hand wavy answers.
Was this around the time right after “custom GPTs” was introduced? I’ve seen posts since basically the beginning of ChatGPT claming
it got stupid and thinking it was just confirmation bias. But somewhere around that point I felt a shift myself in GPT4:s ability to program; where it before found clever solutions to difficult problems, it now often struggles with basics.
This is my guess as well. They have been limiting new signups for the paid service for a long time, which must mean they are overloaded; and then it makes a lot of sense to just degrade the quality of GPT-4 so they can serve all paying users. I just wish there was a way to know the “quality level” the service is operating at.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world
This is a most excellent place for technology news and articles.
English
Honestly I kinda wish it would give shorter answers unless I ask for a lot of detail. I can use those custom instructions but it’s tedious difficult to tune that properly.
Like if I ask it ‘how to do XYZ in blender’ it gives me a long winded response, when it could have just said ‘Hit Ctrl-Shift-Alt-C’
It would be awesome if someone had been querying it with the same prompt periodically (every day or something), to compare how responses have changed over time.
I guess the best time to have done this would have been when it first released, but perhaps the second best time is now…
GPT Unicorn is one that’s been going on a while. There’s a link to the talk on that website that’s a pretty good watch too.
My partner is a CompSci teacher and have been training a local llm in her class. As soon as they named their AI it started producing all these weird emotes with every answer, it became super annoying to where it would rather make up stuff than say I don’t know that answer. It was definitely an eye opener for the kids.
Am late to the game here but after reading the article I would agree.
I use it off and on if I am looking up formulas and scripts and find it a great tool for work. It saves a ton of time. It works great and haven’t noticed any change there. Request it to give/write you a specific formula to solve X and it will. It’s a huge time saver.
But I’ve found recently if I am trying to just find information on a subject that I want summarized or something found on the web and explained it will often ‘recommend I check out the company’s website for the latest news or recent developments.’
That last statement was an exact quote I got recently that made me laugh when I went asking for the explanation of how something worked. It was a NO SHIT SHERLOCK moment I had after getting several of these sort of replies.
I mean I har gotten detailed explanations of string theory ages back from ChatGPI and now it’s telling me ‘ummm just go look it up - I can’t right now…m
ChatGPT has entered the teenage years.
First it just starts making shit up, then lying about it, now it’s just at the stage where it’s like, “Fuck this shit.” It’s becoming more human by the day.
Human. After all.
I feel like the quality has been going down especially when you ask it anything that may hint at anything “immoral” and it starts giving you a whole lecture instead of answering.
Perhaps this is how general AI comes about. “Why the fuck would I do that?”
You fucked up a perfectly good algorithm is what you did! Look at it! It’s got depression!
I’m surprised they don’t consider it a breakthrough. “We have created Artificial Depression.”
Working smarter
Yep, I spent a month refactoring a few thousand lines of code using GPT4 and I felt like I was working with the best senior developer with infinite patience and availability.
I could vaguely describe what I was after and it would identify the established programming patterns and provide examples based on all the code snippets I fed it. It was amazing and a little terrifying what an LLM is capable of. It didn’t write the code for me but it increased my productivity 2 fold… I’m a developer now a getting rusty being 5 years into management rather than delivering functional code, so just having that copilot was invaluable.
Then one day it just stopped. It lost all context for my project. I asked what it thought what we were working on and it replied with something to do with TCP relays instead of my little Lua pet project dealing with music sequencing and MIDI processing… not even close to the fucking ballpark’s overflow lot.
It’s like my trusty senior developer got smashed in the head with a brick. And as described, would just give me nonsense hand wavy answers.
Was this around the time right after “custom GPTs” was introduced? I’ve seen posts since basically the beginning of ChatGPT claming it got stupid and thinking it was just confirmation bias. But somewhere around that point I felt a shift myself in GPT4:s ability to program; where it before found clever solutions to difficult problems, it now often struggles with basics.
removed by mod
They probably have to scale down the resources used for each query as they can’t scale up their infrastructure to handle the load.
This is most likely the answer. Management saw the revenue and cost and said, “whoa! Turn all that unnecessary stuff off!”
This is my guess as well. They have been limiting new signups for the paid service for a long time, which must mean they are overloaded; and then it makes a lot of sense to just degrade the quality of GPT-4 so they can serve all paying users. I just wish there was a way to know the “quality level” the service is operating at.
“ChatGPT Caught Faking On-Site Injury for L&I”
Jeez. Not even AI wants to work anymore!
God damn avocado toast
So its gone from loosing quality to just giving incomplete answers. Its clearly developed depression, and its because of us.
To be fair, it has a brain the size of a planet so it thinks we are asking it rather dumb questions
MarvinGPT
MarvinPilled
Who TF gave it a genuine people personality?
CAN YOU MAKE IT RHYME THO
ChatGPT: oh god, why