[SOLVED] OpenVZ XFS quota problem

Rokixz

New Member
Aug 26, 2014
11
0
1
Šiauliai, Lithuania
Hello,

first I want to say hello for all community, I really enjoy Proxmox and I found it really useful. I do configured it and most of features are working out of the box, but I have one little problem with OpenVZ quota.
I'm using LVM based XFS partitions for all disks alongside software RAID1, all I can see is just total space, but 0 used (for /var/lib/vz/private/$ctid containers):
Code:
root@node1:~# df -h
Filesystem                            Size  Used Avail Use% Mounted on
udev                                   10M     0   10M   0% /dev
tmpfs                                 2.4G  2.5M  2.4G   1% /run
/dev/mapper/pve-root                   94G  9.1G   85G  10% /
tmpfs                                 5.0M     0  5.0M   0% /run/lock
tmpfs                                 4.7G   25M  4.7G   1% /run/shm
/dev/mapper/backup-backup             1.6T  320G  1.3T  20% /backup
/dev/md0                              228M   25M  196M  12% /boot
/dev/mapper/pve-data                  1.7T  724G  952G  44% /var/lib/vz
/dev/mapper/perseusdb-namuakcentai     25G  3.7G   22G  15% /mnt/nadb
/dev/mapper/perseusdb-homehighlights   25G  380M   25G   2% /mnt/hhdb
/dev/fuse                              30M   24K   30M   1% /etc/pve
/var/lib/vz/private/100               500G     0  500G   0% /var/lib/vz/root/100
/mnt/nadb                              25G  3.7G   22G  15% /var/lib/vz/root/100/var/lib/mysql
none                                  6.1G  4.0K  6.1G   1% /var/lib/vz/root/100/dev
/var/lib/vz/private/101               500G     0  500G   0% /var/lib/vz/root/101
/mnt/hhdb                              25G  380M   25G   2% /var/lib/vz/root/101/var/lib/mysql
none                                  1.3G  1.2M  1.3G   1% /var/lib/vz/root/100/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/100/run/lock
none                                  2.9G     0  2.9G   0% /var/lib/vz/root/100/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/100/run/user
none                                  6.1G  4.0K  6.1G   1% /var/lib/vz/root/101/dev
/var/lib/vz/private/102               952G     0  952G   0% /var/lib/vz/root/102
none                                  1.3G  1.2M  1.3G   1% /var/lib/vz/root/101/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/101/run/lock
none                                  2.9G     0  2.9G   0% /var/lib/vz/root/101/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/101/run/user
none                                  4.0G  4.0K  4.0G   1% /var/lib/vz/root/102/dev
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103
none                                  820M  1.2M  819M   1% /var/lib/vz/root/102/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/102/run/lock
none                                  2.0G     0  2.0G   0% /var/lib/vz/root/102/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/102/run/user
none                                  4.0G  4.0K  4.0G   1% /var/lib/vz/root/103/dev
/var/lib/vz/private/104               952G     0  952G   0% /var/lib/vz/root/104
none                                  820M  1.2M  819M   1% /var/lib/vz/root/103/run
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web1/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web2/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web4/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web5/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web6/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web8/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web13/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web14/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web17/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web18/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web19/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web20/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web23/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web27/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web28/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client4/web29/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client4/web30/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web31/log
none                                  5.0M  4.0K  5.0M   1% /var/lib/vz/root/103/run/lock
none                                  2.0G     0  2.0G   0% /var/lib/vz/root/103/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/103/run/user
none                                  4.0G  4.0K  4.0G   1% /var/lib/vz/root/104/dev
none                                  820M  1.4M  818M   1% /var/lib/vz/root/104/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/104/run/lock
none                                  2.0G     0  2.0G   0% /var/lib/vz/root/104/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/104/run/user


/proc/mounts/:
Code:
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,relatime,size=10240k,nr_inodes=3072445,mode=755 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,noexec,relatime,size=2459932k,mode=755 0 0
/dev/mapper/pve-root / xfs rw,relatime,attr2,delaylog,noquota 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
tmpfs /run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=4919860k 0 0
/dev/mapper/backup-backup /backup xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/md0 /boot ext2 rw,relatime,errors=continue 0 0
/dev/mapper/pve-data /var/lib/vz xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/mapper/perseusdb-namuakcentai /mnt/nadb xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/mapper/perseusdb-homehighlights /mnt/hhdb xfs rw,relatime,attr2,delaylog,noquota 0 0
rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
/dev/fuse /etc/pve fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other 0 0
beancounter /proc/vz/beancounter cgroup rw,relatime,blkio,name=beancounter 0 0
container /proc/vz/container cgroup rw,relatime,freezer,devices,name=container 0 0
fairsched /proc/vz/fairsched cgroup rw,relatime,cpuacct,cpu,cpuset,name=fairsched 0 0
/var/lib/vz/private/100 /var/lib/vz/root/100 simfs rw,relatime,usrquota,grpquota 0 0
/mnt/nadb /var/lib/vz/root/100/var/lib/mysql simfs rw,relatime 0 0
proc /var/lib/vz/root/100/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/100/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/dev devtmpfs rw,nosuid,noexec,relatime,size=6389760k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/100/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/101 /var/lib/vz/root/101 simfs rw,relatime,usrquota,grpquota 0 0
/mnt/hhdb /var/lib/vz/root/101/var/lib/mysql simfs rw,relatime 0 0
proc /var/lib/vz/root/101/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/101/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/run tmpfs rw,nosuid,noexec,relatime,size=1277952k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/100/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1597440 0 0
none /var/lib/vz/root/100/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2975320k,nr_inodes=1597440 0 0
none /var/lib/vz/root/100/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/dev devtmpfs rw,nosuid,noexec,relatime,size=6389760k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/102 /var/lib/vz/root/102 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/102/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/102/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/101/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/101/run tmpfs rw,nosuid,noexec,relatime,size=1277952k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1597440 0 0
none /var/lib/vz/root/101/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2975320k,nr_inodes=1597440 0 0
none /var/lib/vz/root/101/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/102/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/102/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/103/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/103/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/102/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/102/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/102/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/102/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/102/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/103/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/103/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/104 /var/lib/vz/root/104 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/104/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/104/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/103/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/103/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web1/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web2/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web4/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web5/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web6/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web8/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web13/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web14/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web17/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web18/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web19/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web20/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web23/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web27/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web28/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client4/web29/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client4/web30/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web31/log simfs rw,relatime,usrquota,grpquota 0 0
none /var/lib/vz/root/103/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/103/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/103/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
none /var/lib/vz/root/104/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/104/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/104/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/104/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0



But it's all ok with Inodes, I can see how many files are there.

So if there's anything I need to install or just vzquota doesn't support XFS?

The main vz.conf:

Code:
## Global parameters
VIRTUOZZO=yes
LOCKDIR=/var/lib/vz/lock
DUMPDIR=/var/lib/vz/dump
VE0CPUUNITS=1000

## Logging parameters
LOGGING=yes
LOGFILE=/var/log/vzctl.log
LOG_LEVEL=0
VERBOSE=0

## Disk quota parameters
DISK_QUOTA=yes
VZFASTBOOT=no

# Disable module loading. If set, vz initscript does not load any modules.
#MODULES_DISABLED=yes

# The name of the device whose IP address will be used as source IP for CT.
# By default automatically assigned.
#VE_ROUTE_SRC_DEV="eth0"

# Controls which interfaces to send ARP requests and modify ARP tables on.
NEIGHBOUR_DEVS=detect

## Fail if there is another machine in the network with the same IP
ERROR_ON_ARPFAIL="no"

## Template parameters
TEMPLATE=/var/lib/vz/template

## Defaults for containers
VE_ROOT=/var/lib/vz/root/$VEID
VE_PRIVATE=/var/lib/vz/private/$VEID

## Filesystem layout for new CTs: either simfs (default) or ploop
#VE_LAYOUT=ploop

## Load vzwdog module
VZWDOG="no"

## IPv4 iptables kernel modules to be enabled in CTs by default
IPTABLES="ipt_REJECT ipt_tos ipt_limit ipt_multiport iptable_filter iptable_mangle ipt_TCPMSS ipt_tcpmss ipt_ttl ipt_length"
## IPv4 iptables kernel modules to be loaded by init.d/vz script
IPTABLES_MODULES="$IPTABLES"

## Enable IPv6
IPV6="yes"

## IPv6 ip6tables kernel modules
IP6TABLES="ip6_tables ip6table_filter ip6table_mangle ip6t_REJECT"



The one of my VPS config looks like that:
Code:
ONBOOT="yes"

PHYSPAGES="0:8192M"
SWAPPAGES="0:2048M"
KMEMSIZE="3723M:4096M"
DCACHESIZE="1861M:2048M"
LOCKEDPAGES="4096M"
PRIVVMPAGES="unlimited"
SHMPAGES="unlimited"
NUMPROC="unlimited"
VMGUARPAGES="0:unlimited"
OOMGUARPAGES="0:unlimited"
NUMTCPSOCK="unlimited"
NUMFLOCK="unlimited"
NUMPTY="unlimited"
NUMSIGINFO="unlimited"
TCPSNDBUF="unlimited"
TCPRCVBUF="unlimited"
OTHERSOCKBUF="unlimited"
DGRAMRCVBUF="unlimited"
NUMOTHERSOCK="unlimited"
NUMFILE="unlimited"
NUMIPTENT="unlimited"

# Disk quota parameters (in form of softlimit:hardlimit)
DISKSPACE="1000G:1100G"
DISKINODES="200000000:220000000"
QUOTATIME="0"
QUOTAUGIDLIMIT="10000"

# CPU fair scheduler parameter
CPUUNITS="1000"
CPUS="4"
HOSTNAME="server1.ispconfig.lt"
SEARCHDOMAIN="ispconfig.lt"
NAMESERVER="5.199.160.160"
IP_ADDRESS="5.199.163.8"
VE_ROOT="/var/lib/vz/root/$VEID"
VE_PRIVATE="/var/lib/vz/private/103"
OSTEMPLATE="debian-7.0-x86_64-minimal.tar.gz"

Most of them are similar. Previously I was running CentOS6 with OpenVZ kernel and ext4 and quota display and count was fine, the problem came after I switched to LVM, XFS and Proxmox. I really appreciate for the reply and help.

P.S.

Seems OpenVZ doesn't support XFS quotas, thanks for spirit for replay:
Hi,
openvz quotas is not supported on xfs. Proxmox default fs is ext3


https://openvz.org/Disk_quota
"
Filesystem dependency

If your host filesystem is not ext2/3/4 (like XFS) the disk quotas will not work inside containers.
"

I did shut down quota in /etc/vz/vz.conf by changing line to:
DISK_QUOTA=no

than restart vz service:
service vz restart

Hope support will be enabled one day.
 
Last edited:
Oh, I don't know why I didn't noticed that... Anyway, thanks for a swift reply :) I'll keep XFS anyway as I use the server for personal reasons :) Thanks once again!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!