Hi,
Are you still having these issues? I just updated my environment from 8.4 to 9.1, and since them, I'm having IO issues and random reboots. As mentioned before, the workaround looks to be pinning the kernel to version 6.14, but it isn't...
Regarding Ceph: The PVE wiki has a page how to set up a mesh network for three nodes. This saves some bucks because you will need less switches: https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server
The reference doc chapter on...
Never used it with this option in my mind. Although I thankfully recognized that I only need one instance of that script per cluster, so obviously it integrates into PVE :-)
Regarding Ceph: The PVE wiki has a page how to set up a mesh network for three nodes. This saves some bucks because you will need less switches: https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server
The reference doc chapter on...
Thanks for your input, Johannes S.
This is exactly why we are testing as much possibilities as we can.
And, at the moment, we are learning very much every day.
In the past we would have installed a small VMWare cluster with shared storage...
can you check the file-restore logs under /var/log/proxmox-backup/file-restore (on the Proxmox VE host)?
this message appears usually when there is a filesystem in use in the guest that is not readable with a linux kernel
also, please update...
Try to update the firmware of your Samsung drives.
Try to disable PCIe ASPM in BIOS or any other power saving feature.
Check if the drives overheat -> improve cooling.
Could also be an issue with the pcie -> m.2 adapter ...
Hi @kd-infradijon,
Thanks for replying back.
I can see from your thread that the solution was to force 10G (or 25G) links instead of auto-negotiation?
We didn't have the ability to do this in our case, as the three existing nodes have 1G NICs...
Are there any companies that extensively use PVE in daily production environments?
Our data center currently utilizes commercial virtualization software. When issues arise, we rely on the vendor for support. However, the downside is the high...
Unless you use some Linux tools to set it explicitely, the actual power modes are determined by the BIOS. Both Intel CPUs should use around the same power when idle, the difference is the ACPI settings which determine how deep the sleep states...
After all we were unable to find a satisfactory solution with the ring topology. We kept experiencing the same issues over and over again.
We have now switched to a star topology using a 10 Gbit switch. Since then, the problems have disappeared...
Thanks for the detailed network diagram. Pulling together everything you've shared, I think the picture is fairly clear now -- though some targeted measurements would still help confirm the timing.
The core reason VMs freeze
During Ceph...
Alot of suggestions already, thank you! To answer some of the comments above:
- I have not done any custom tuning on the previous server.
And as @proxuser77 says, all suggestions are welcome, Proxmox specific ones, but also BIOS and hardware...
Yes, this is exactly what i wanted clarified, thank you. And i can tell you, it's not clear to me with 1/2 year of experience with Linux, mostly in Ubuntu. Although, further help besides Proxmox related does not hurt, so all suggestions are...
Give something like this a look
grep -r . /sys/class/powercap/intel-rapl:0/constraint*
grep -r . /sys/devices/system/cpu/cpufreq/policy*/energy_performance_preference
There might also be PL1/PL2 options in the UEFI of the device. My MiniPC...