PBS-ZFS Storage is at 100%

K

Konjua

New Member
Feb 26, 2025
1
0
1
Hi

Our PBS today ran out of storage, it's sitting at 100% and "zpool status" outputs "no pools available"

We've been getting (os error 28)

Full error log:

"ERROR: Backup of VM XYZ failed - VM XYZ qmp command 'backup' failed - backup connect failed: command error: No space left on device (os error 28)"

I was wondering if someone could eventually help me expand the PBS volume size. Deleting old backups is last option I'd want to take.

Thanks a lot in forward!

P.s. I'm somewhat of a newbie when it comes to Proxmox. I'd greatly appreciate somewhat simplified responses
 
Hey there. First thing to know is that you are not alone. This happens.

Second thing to know is the same as the first. This happens. A lot.
There's a bunch of stuff in this forum to read about this very same problem.
And there's a lot to know. Various complexities.
You really need to search and read. Not kidding. It will be worth your time.

And then as to your own issue ... Post the output from these statements in order for us to help you further.

df -h

cat /etc/proxmox-backup/datastore.cfg
 
Hi same problem here. This is the output in my case:

root@pbs2:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 12G 0 12G 0% /dev
tmpfs 2.4G 1.8M 2.4G 1% /run
/dev/mapper/pbs-root 524G 7.8G 489G 2% /
tmpfs 12G 0 12G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 2.4G 0 2.4G 0% /run/user/1000

root@pbs2:~# cat /etc/proxmox-backup/datastore.cfg
datastore: DATA
gc-schedule daily
path /mnt/datastore/DATA
 
Update: It seems we have damaged disks:

root@pbs2:~# zpool import
pool: DATA
id: 6186135072450881128
state: UNAVAIL
status: One or more devices contains corrupted data.
action: The pool cannot be imported due to damaged devices or data.
see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-5E
config:

DATA UNAVAIL insufficient replicas
raidz1-0 UNAVAIL insufficient replicas
sdb ONLINE
sdc ONLINE
sdd ONLINE
sde ONLINE
sdf FAULTED corrupted data
sdg FAULTED corrupted data
scsi-3600605b002f0c3b02e6231ab204444a5 ONLINE
scsi-3600605b002f0c3b02e6231ab2044bade ONLINE
scsi-3600605b002f0c3b02e6231ab204530d0 ONLINE
scsi-3600605b002f0c3b02e6231ac2045a897 ONLINE
 
You must log in or register to reply here.
Top Bottom