mktemp: failed to create file

[davosian]

Hi there, one of my proxmox nodes gives me the following error message, whenever I log into the node with ssh:

mktemp: failed to create file via template ‘/tmp/tmp.XXXXXXXXXX’: Read-only file system
mktemp: failed to create file via template ‘/tmp/tmp.XXXXXXXXXX’: Read-only file system

I can temporarly fix this by running

fsck -f -c -y /dev/mapper/pve-root

and rebooting the server. Now the cluster is up again without reporting any errors. The moment I reboot this particular node once more, I am back to the same error. Sounds like a bad disk, but every check I ran so far did not reveal any errors. Which disk would that be anyways (I have two inside, /dev/sda and /dev/sdb)?

Any idea what is going on here?

(running on Proxmox 8.1.3 with Ceph on a 3 node cluster)

 

[fabian]

1. usually /tmp would be a tmpfs backed by RAM, not part of any physical disk
2. if it is backed by a real disk/filesystem and goes read-only at some point, there should be some notice in the system logs about remounting read-only