does passthrough for a 3090 or two work on esxi 7 or 8 for vm for stable diffusion tts llama? if so what would be the recommended host os and set up? I currently have a 3090 in my windos 10 pro workstation that i use for this those tasks but also use workstation for work and games. I would like to set up something for training 24 7. host server would be a 32 or 64 core epyc w 256 ram super micro h12ssl nt mb that would also host vms for other tasks. if this doest work may look at building a separate ai server. I may get a used 3090 now and put add my workstation 3090 later or upgrade to 4090 on workstation if there good black friday deal.

  • AttackPanda@programming.dev
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    I use PCI pass through for my 2080 Super on ESXi and it works but I’m only doing single host utilization. I think for VMs to share the GPU, you need the NVIDIA licensed driver which is pricey. If just a single VM needs the GPU (my case) then it’s just standard PCI Passthrough.