I currently have a Dell PowerEdge T430 with a 20c CPU and 128 GB of RAM running Proxmox. Right now I just have an old 240 GB SSD and 4 4 TB hard drives in RAIDZ-2. I have a Plex server in the cloud that I would like to localize including bringing the data in house. Right now my data footprint is around 170 TB but I am trying to whittle that down to around 100 TB.
I am trying to figure out the best way to store the data for Plex. I use Proxmox for things like hosting game servers and hosting software that I use for work. There are only 8 HDD trays so it is not enough for a 100 TB+ storage array. What would be the best way to utilize the hardware I currently have while adding a large array of storage to use?
Ultimately I would like to utilize RAIZ-2 or similar so I have some redundancy and I would love to be able to expand the array as I add more drives to it since I figure my data footprint will continue to grow. Thanks!
2 vdevs with 10 x 10TB drives in RAID-Z2 would give you around 150TB useable.
So you could do that with one vdev and 10 x 20TB disks, but you wouldn’t have as good performance and 20TB disks take a long time to resilver if you have to replace one.
If you need more HDD trays you can probably add additional 3.5" drive bays in the 5.25" slots using something like an IcyDock. I did that on my tower server to add 2.5" slots for SSDs, but similar ones exist for 3.5" drives.
Pick yourself up an MD3060e and fill it with 12-16tb hgst SAS Drives. Pair them up as 4+2 or 8+2 raidz2 groups based on your risk tolerance and needs, and remember that no matter how small you prune your data, it will continue to grow. Make sure you have plenty of capacity to grow into. If you haven’t got an accurate projection of your growth, then you should provision between two and ten times what you think you’ll need, depending on how much growth capacity you have in your hardware, and then calculate your actual growth rate for future planning