I am wanting to know if this is currently possible or if this would even be worth implementing if it is not possible with the current ProxmoxVE release. This will, unfortunately, be a bit of a long post but ill try and be as concise as possible.
Server Background: I have ProxmoxVE (currently 7.1-1) setup on 7 different servers they are a mix of old enterprise hardware with the majority being HPE DL380G5 machines but there is a Dell PE2950 G3 as well as an HPE DL385 G5 and a custom-built Supermicro motherboard in a Rosewill 4U chassis as well. All of the machines have 2 CPUs and all are Xeons with the only exception being the DL385 is dual AMD CPUs. They all have dual OS disks (2 x 250 GB SSDs) running in RAID as I am not able to flash the cards to IT, though the Supermicro is running Mirrored ZFS as it does not have onboard RAID. Also they all have 32 GB of RAM except the Supermicro as 96 GB.
Storage Background: I have 3 QNAP devices all with 16 GB RAM and are running TrueNAS Core with 2 of them having 4 x 6 TB HDDs and the other having 8 x 8 TB HDDs. The shares are setup so that the 8-bay device has storage for ISO Images and Virtual Machine Backups. The other 4-bay devices have storage configured for Virtual Machine Disk Images.
What I am hoping to setup for my pfSense Virtual Machine is a mirrored ZFS boot where one disk is on one of the storage devices and the other is on the second storage device, essentially creating a somewhat DIY/Consumer "Poor-mans" High Availability storage solution. I should note that I do plan to move from using NAS devices to store Virtual Machine disks to CEPH or a similar distributed file system but that will happen when I both upgrade to 10g networking and build new servers with no RAID and more room for disks (the plan is to have 2 mirrored OS disks and 6 storage disks per system)
Now when I have set this up in testing when everything is online there are no issues and if one of the storage devices goes offline there are also no issues and when it comes back online ZFS on the Virtual Machine handles syncing the disk that was missing. The problem happens if the Virtual Machine needs to restart for whatever reason is starting with one of the disks missing as Proxmox will not allow it to boot with a hardware device unavailable.
Is there a way to mark or denote hardware as "Optional" or "nice to have" so that the machine will boot with either disk missing? I know that if I were to mark both HDDs as optional and none were available then the machine would boot but of course would be stuck in a boot loop.
Server Background: I have ProxmoxVE (currently 7.1-1) setup on 7 different servers they are a mix of old enterprise hardware with the majority being HPE DL380G5 machines but there is a Dell PE2950 G3 as well as an HPE DL385 G5 and a custom-built Supermicro motherboard in a Rosewill 4U chassis as well. All of the machines have 2 CPUs and all are Xeons with the only exception being the DL385 is dual AMD CPUs. They all have dual OS disks (2 x 250 GB SSDs) running in RAID as I am not able to flash the cards to IT, though the Supermicro is running Mirrored ZFS as it does not have onboard RAID. Also they all have 32 GB of RAM except the Supermicro as 96 GB.
Storage Background: I have 3 QNAP devices all with 16 GB RAM and are running TrueNAS Core with 2 of them having 4 x 6 TB HDDs and the other having 8 x 8 TB HDDs. The shares are setup so that the 8-bay device has storage for ISO Images and Virtual Machine Backups. The other 4-bay devices have storage configured for Virtual Machine Disk Images.
What I am hoping to setup for my pfSense Virtual Machine is a mirrored ZFS boot where one disk is on one of the storage devices and the other is on the second storage device, essentially creating a somewhat DIY/Consumer "Poor-mans" High Availability storage solution. I should note that I do plan to move from using NAS devices to store Virtual Machine disks to CEPH or a similar distributed file system but that will happen when I both upgrade to 10g networking and build new servers with no RAID and more room for disks (the plan is to have 2 mirrored OS disks and 6 storage disks per system)
Now when I have set this up in testing when everything is online there are no issues and if one of the storage devices goes offline there are also no issues and when it comes back online ZFS on the Virtual Machine handles syncing the disk that was missing. The problem happens if the Virtual Machine needs to restart for whatever reason is starting with one of the disks missing as Proxmox will not allow it to boot with a hardware device unavailable.
Is there a way to mark or denote hardware as "Optional" or "nice to have" so that the machine will boot with either disk missing? I know that if I were to mark both HDDs as optional and none were available then the machine would boot but of course would be stuck in a boot loop.
