Can we discuss how it’s possible that the paid model (gpt4) got worse and the free one (gpt3.5) got better? Is it because the free one is being trained on a larger pool of users or what?

  • @Gsus4@lemmy.oneOP
    link
    fedilink
    English
    1211 months ago

    Oh, right, that’s another factor: connecting gpt4 to the real-time internet creates those training loops, yes. The pre-prompt guardrail prompts are fixable and even possible to overcome, but training on synthetic data is the key here, because it’s impossible to identify what is artificial, so on the collapse loop goes.

    • NaibofTabr
      link
      English
      1511 months ago

      connecting gpt4 to the real-time internet creates those training loops, yes… it’s impossible to identify what is artificial, so on the collapse loop goes.

      ouroboros of garbage