Ubuntu server VM crashing from rclone on PVE, what could be the problem?

[atkuzmanov]

Hi,


I am using rclone to sync and then check several source and destination directories.

While it is running the Ubuntu Server VM freezes up.

When the Ubuntu Server VM crashes it becomes completely non responsive, the guest agent stops running, I cannot SSH into the machine.
I also cannot shutdown the machine. Only issuing `STOP` to the VM works in shutting it down, or shutting down the whole ProxMox PVE node, to try and do a more graceful of the VM itself.

It does not seem to be an out of memory issue so far, all indicators of the Ubuntu Server machine seem ok.

It seems like it's not rclone that is freezing the OS, but something related to I/O reading/writing large amounts of data at a very high speed/rate.

---

I researched how to debug Ubuntu Server the best I can, and here is what I came up with so far:

Ubuntu Server DEBUG information:

sudo cat /var/log/kern.log | grep error

https://pastebin.com/S5VS61Tx

sudo cat /var/log/syslog | grep error

https://pastebin.com/kM3jxVwb

---

ProxMox PVE 8.2.4

Ubuntu Server 24.04 (64 bit)

---

Any help in debugging and fixing this is appreciated!

 

[rocasper]

Hi, I am facing a similar issue.
Vm crashes when using dd to write on a partition
Have you found any solution?

 

[atkuzmanov]

Hi, I am facing a similar issue.
Vm crashes when using dd to write on a partition
Have you found any solution?

Hi, I am sorry to hear that and apologies for the delay in replying.

Unfortunately I have not found a solution.

I have narrowed it down to the following, but I haven't had time to try them out:

- The nvme - mine are 2 QLC nvmes running in RAID 1. I assume that QLC performance might not be able to handle the load for some reason. I need to upgrade to TLC nvmes and see if that fixes it, but I have not had the time and/or budget to do it.

- My other presumption is the LSI SAS HBA controller - I think it might be overheating and crashing. My plan is to install some kind of a fan and see if that helps. Again I have not tried it yet.

This is what I have so far, I hope it gives you some clues and helps you.

Also, please let me know if you figure it out, or any hints and clues, please let me know.