error "no space left on device"

bu2chlc

New Member
Jan 27, 2021
14
0
1
51
Hello all, I have a 3 node cluster (running ceph) version 6.3-2.
When I try to open a console to a VM, I get the error, "no space left on device". I get the error on all 3 nodes. I ran DF from each node but get similar results that do not show any disk being 100% used.
Where should I look? Have I included enough info to give you a hint at my problem?
 

Attachments

  • df.txt
    1.5 KB · Views: 13

bofh

Active Member
Nov 7, 2017
126
11
38
43
well technically the error is correct which is the best type of correct.

let me answer with a question: where is your VM storage ?
 

bu2chlc

New Member
Jan 27, 2021
14
0
1
51
well technically the error is correct which is the best type of correct.

let me answer with a question: where is your VM storage ?
stored in a ceph pool, nowhere near being full, less than 10% used actually.
 

ph0x

Renowned Member
Jul 5, 2020
1,326
212
68
/dev/null
Are you trying to open a VM's console or the host's console? If it's a VM then the assigned disk is probably full.
 

bu2chlc

New Member
Jan 27, 2021
14
0
1
51
Are you trying to open a VM's console or the host's console? If it's a VM then the assigned disk is probably full.
I cannot start VM's. the server has no free inodes and there are 900k files in the /var/lib/samba/private/msg.sock/ folder. I am using ceph if that helps. I am now trying to just find a thousand or so files so I can get the vms online to back them up somehow.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!