• Ghostalmedia
    link
    fedilink
    English
    216 days ago

    It definitely comes at a cost though. The private local models will be inherently dumber because of less compute and smaller data sets.

    And, unfortunately, this is a hard thing to communicate to the public. All they know is that Assistant responded to a request better than Siri.

    • @cryptix@discuss.tchncs.de
      link
      fedilink
      English
      115 days ago

      Look into the past , what a huge server does now a small SBC can do now . In 10 years what chatgot runs in cloud could potentially be running in a smartphone