• Swallagoon@alien.topB
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    How exactly do you backup an AI model anyway? How big is an AI model? Is it just a big zip file? ???

    • Masark@alien.topB
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago
      1. You simply download the file and keep it. We’re talking about stuff you can run on your own computer, not services like chatgpt or such.

      2. Highly variable. Depends on model size and format. For LLMs, range would be from under 1GB up to a current maximum of ~240GB.

      3. It’s a big file of numbers (“weights” or “parameters”) either integers or floating point depending on format.

    • candre23@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Anywhere from 1 to several hundred GB. Quantized (compressed), the most popular models are 8-40gb each. LORAs are a lot smaller, but full models take up a lot of space.

  • LP_Mask_Man@alien.topB
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Wait until this thread will be closed or removed too because reddit don’t like criticism of China.