From Lemmy, this link took me to Slashdot, which took me to The Verge, which took me to the Wall Street Journal, each with a section I can discuss this article.
Idk, I find this hard to believe. I would think the challenge is more access to the information (gates, bandwidth), a speedy vault to store that information, and improving their models.
When you think about what’s available on the internet, how much of human knowledge and propaganda is out there. With enough/deus ex tech, there’s no way ai shouldn’t be able to learn most of anything with the knowledge available, and the right trainers.
[T]he Chinchilla scaling law for training Transformer language models suggests that when given an increased budget (in FLOPs), to achieve compute-optimal, the number of model parameters (N) and the number of tokens for training the model (D) should scale in approximately equal proportions.
Well, that’s the rub, right? Garbage in, garbage out. For an LLM, the value is predicting the next token, but we’ve seen how racist current datasets can be. If you filter it, there’s not as much lot of high quality data left.
So yes, we have a remarkable amount of (often wrong) information to pull from.
Mhm, I wonder when we’ll have the resources to build one that can tell the truth from other lies. I suppose you have to learn to crawl before you learn to walk, but these things still having trouble rolling over.
All will bow to profits as long as Mammon still tops the paradigm. Change the main motivator of the world from profit and you will see this go away. I hate it more than anything. It consumes all and leaves nothing.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world
This is a most excellent place for technology news and articles.
Everything’s too small for power-hungry corporations with an irrational need for infinite expansion.
From Lemmy, this link took me to Slashdot, which took me to The Verge, which took me to the Wall Street Journal, each with a section I can discuss this article.
Idk, I find this hard to believe. I would think the challenge is more access to the information (gates, bandwidth), a speedy vault to store that information, and improving their models.
When you think about what’s available on the internet, how much of human knowledge and propaganda is out there. With enough/deus ex tech, there’s no way ai shouldn’t be able to learn most of anything with the knowledge available, and the right trainers.
Yes, it’s BS, like most of the AI takes here.
The kernel of truth is scaling laws:
Well, that’s the rub, right? Garbage in, garbage out. For an LLM, the value is predicting the next token, but we’ve seen how racist current datasets can be. If you filter it, there’s not as much lot of high quality data left.
So yes, we have a remarkable amount of (often wrong) information to pull from.
Mhm, I wonder when we’ll have the resources to build one that can tell the truth from other lies. I suppose you have to learn to crawl before you learn to walk, but these things still having trouble rolling over.
deleted by creator
All will bow to profits as long as Mammon still tops the paradigm. Change the main motivator of the world from profit and you will see this go away. I hate it more than anything. It consumes all and leaves nothing.
Everything’s a competition for company profits.