This new technology could blow away GPT-4 and everything like it
-
Kent Sharkey wrote:
Is it common sense?
As long as the "medicine" is not worse than the disease...
Quote:
It's important to note that the Hyena program shown in the paper is small in size compared to GPT-4 or even GPT-3. While GPT-3 has 175 billion parameters, or weights, the largest version of Hyena has only 1.3 billion parameters. Hence, it remains to be seen how well Hyena will do in a full head-to-head comparison with GPT-3 or 4. But, if the efficiency achieved holds across larger versions of the Hyena program, it could be a new paradigm that's as prevalent as attention has been during the past decade.
I hope this is not the step #2 towards our future robot overlords :~
Kent Sharkey wrote:
Is it common sense?
Why is it that common sense is not so common? :doh: :sigh:
M.D.V. ;) If something has a solution... Why do we have to worry about?. If it has no solution... For what reason do we have to worry about? Help me to understand what I'm saying, and I'll explain it better to you Rating helpful answers is nice, but saying thanks can be even nicer.