Ok, here's something that is boggling my mind, not hard to do though.
So recently my VM's started getting really slow, lagged.
I am running a dual xeon E5-2698 v3 server, with 256gb ram, it's a Hauwei server with a built in Avago raid controller. I configured the boot drive in hardware as a mirrored 500gb Samsung SSD, and then had 4 cheapo 2tb SSD's in a ZFS RAIDZ array, it ran really well for like 6 months that way until I noticed the latency.
zpool status shows everything ok, I had backups so I just wiped the pool, set it back up, and now when I restore a backup to the pool, or even a single drive set up and it appears to copy the VM image to the drive, but it doesn't restore the config file to /etc/pve/qemu-server folder, kind of just a minimal config file. Now when I check the config from the backups before restore, it looks like it should.
Now here is where my mind goes crazy.
I do a restore of the VM to an NFS share on my Truenas, and it restores the config file properly and boots fine.
The system boot drive is on the same controller, I even reinstalled Proxmox to see if there was something there. Different drives, I had a new Samsung 870 that I stuck into a bay, moved it to a bay I had never used, tried a 1tb WD HDD I had running in another system.
At this point I tend to think hardware, but I can reaad/write to the drives on the controller and the system itself runs rock solid. General drive tests come back as normal too.
So has anyone else ever had this happen? I'm tempted to buy a new raid controller as that is the only thing I can think of at this point. But thought I would throw this out there and see if anyone else ever had this problem.
So recently my VM's started getting really slow, lagged.
I am running a dual xeon E5-2698 v3 server, with 256gb ram, it's a Hauwei server with a built in Avago raid controller. I configured the boot drive in hardware as a mirrored 500gb Samsung SSD, and then had 4 cheapo 2tb SSD's in a ZFS RAIDZ array, it ran really well for like 6 months that way until I noticed the latency.
zpool status shows everything ok, I had backups so I just wiped the pool, set it back up, and now when I restore a backup to the pool, or even a single drive set up and it appears to copy the VM image to the drive, but it doesn't restore the config file to /etc/pve/qemu-server folder, kind of just a minimal config file. Now when I check the config from the backups before restore, it looks like it should.
Now here is where my mind goes crazy.
I do a restore of the VM to an NFS share on my Truenas, and it restores the config file properly and boots fine.
The system boot drive is on the same controller, I even reinstalled Proxmox to see if there was something there. Different drives, I had a new Samsung 870 that I stuck into a bay, moved it to a bay I had never used, tried a 1tb WD HDD I had running in another system.
At this point I tend to think hardware, but I can reaad/write to the drives on the controller and the system itself runs rock solid. General drive tests come back as normal too.
So has anyone else ever had this happen? I'm tempted to buy a new raid controller as that is the only thing I can think of at this point. But thought I would throw this out there and see if anyone else ever had this problem.