• henrikx@lemmy.dbzer0.comEnglish
    1812·
    4 个月前

    You should all see the story about the invention blue LEDs. No one believed that it could work except some japanese guy (Shuji Nakamura) who kept working on it despite his company telling him to stop. No one believed it could ever be solved despite being so close. He solved it and the rewards were astronomical.

    This could very well be another case of being so close to a breakthrough. Two years since GPT-3 came out is nothing. If you were paying any sort of attention you would see there are promising papers coming out almost every week. It’s clear there is a lot we don’t know about training neural nets effectively. Our own brains are the proof of that.

    • zbyte64@awful.systemsEnglish
      201·
      4 个月前

      I mean if you ignore all the papers that point out how dubious the gen AI benchmarks are, then it is very impressive.

    • cley_faye@lemmy.worldEnglish
      191·
      4 个月前

      No one believed that it could work except some japanese guy

      There is a difference in not knowing how to do a thing and someone coming out doing the thing, and knowing how something works, knowing it’s by design limitations, and still hoping it may work out.

    • raspberriesareyummy@lemmy.worldEnglish
      42·
      4 个月前

      mwahahah. The people who are working on LLMs right now are the dumbasses and MBAs of the industry. If we ever get anything like an artificial general AI, it will come from a team of serious researchers / engineers who don’t give a shit about marketing.