[SOLVED] OpenVZ XFS quota problem

Rokixz

New Member
Aug 26, 2014
11
0
1
Šiauliai, Lithuania
Hello,

first I want to say hello for all community, I really enjoy Proxmox and I found it really useful. I do configured it and most of features are working out of the box, but I have one little problem with OpenVZ quota.
I'm using LVM based XFS partitions for all disks alongside software RAID1, all I can see is just total space, but 0 used (for /var/lib/vz/private/$ctid containers):
Code:
root@node1:~# df -h
Filesystem                            Size  Used Avail Use% Mounted on
udev                                   10M     0   10M   0% /dev
tmpfs                                 2.4G  2.5M  2.4G   1% /run
/dev/mapper/pve-root                   94G  9.1G   85G  10% /
tmpfs                                 5.0M     0  5.0M   0% /run/lock
tmpfs                                 4.7G   25M  4.7G   1% /run/shm
/dev/mapper/backup-backup             1.6T  320G  1.3T  20% /backup
/dev/md0                              228M   25M  196M  12% /boot
/dev/mapper/pve-data                  1.7T  724G  952G  44% /var/lib/vz
/dev/mapper/perseusdb-namuakcentai     25G  3.7G   22G  15% /mnt/nadb
/dev/mapper/perseusdb-homehighlights   25G  380M   25G   2% /mnt/hhdb
/dev/fuse                              30M   24K   30M   1% /etc/pve
/var/lib/vz/private/100               500G     0  500G   0% /var/lib/vz/root/100
/mnt/nadb                              25G  3.7G   22G  15% /var/lib/vz/root/100/var/lib/mysql
none                                  6.1G  4.0K  6.1G   1% /var/lib/vz/root/100/dev
/var/lib/vz/private/101               500G     0  500G   0% /var/lib/vz/root/101
/mnt/hhdb                              25G  380M   25G   2% /var/lib/vz/root/101/var/lib/mysql
none                                  1.3G  1.2M  1.3G   1% /var/lib/vz/root/100/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/100/run/lock
none                                  2.9G     0  2.9G   0% /var/lib/vz/root/100/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/100/run/user
none                                  6.1G  4.0K  6.1G   1% /var/lib/vz/root/101/dev
/var/lib/vz/private/102               952G     0  952G   0% /var/lib/vz/root/102
none                                  1.3G  1.2M  1.3G   1% /var/lib/vz/root/101/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/101/run/lock
none                                  2.9G     0  2.9G   0% /var/lib/vz/root/101/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/101/run/user
none                                  4.0G  4.0K  4.0G   1% /var/lib/vz/root/102/dev
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103
none                                  820M  1.2M  819M   1% /var/lib/vz/root/102/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/102/run/lock
none                                  2.0G     0  2.0G   0% /var/lib/vz/root/102/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/102/run/user
none                                  4.0G  4.0K  4.0G   1% /var/lib/vz/root/103/dev
/var/lib/vz/private/104               952G     0  952G   0% /var/lib/vz/root/104
none                                  820M  1.2M  819M   1% /var/lib/vz/root/103/run
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web1/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web2/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web4/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web5/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web6/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web8/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web13/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web14/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web17/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web18/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web19/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web20/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web23/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web27/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client1/web28/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client4/web29/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client4/web30/log
/var/lib/vz/private/103               952G     0  952G   0% /var/lib/vz/root/103/var/www/clients/client2/web31/log
none                                  5.0M  4.0K  5.0M   1% /var/lib/vz/root/103/run/lock
none                                  2.0G     0  2.0G   0% /var/lib/vz/root/103/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/103/run/user
none                                  4.0G  4.0K  4.0G   1% /var/lib/vz/root/104/dev
none                                  820M  1.4M  818M   1% /var/lib/vz/root/104/run
none                                  5.0M     0  5.0M   0% /var/lib/vz/root/104/run/lock
none                                  2.0G     0  2.0G   0% /var/lib/vz/root/104/run/shm
none                                  100M     0  100M   0% /var/lib/vz/root/104/run/user


/proc/mounts/:
Code:
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,relatime,size=10240k,nr_inodes=3072445,mode=755 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,noexec,relatime,size=2459932k,mode=755 0 0
/dev/mapper/pve-root / xfs rw,relatime,attr2,delaylog,noquota 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
tmpfs /run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=4919860k 0 0
/dev/mapper/backup-backup /backup xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/md0 /boot ext2 rw,relatime,errors=continue 0 0
/dev/mapper/pve-data /var/lib/vz xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/mapper/perseusdb-namuakcentai /mnt/nadb xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/mapper/perseusdb-homehighlights /mnt/hhdb xfs rw,relatime,attr2,delaylog,noquota 0 0
rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
/dev/fuse /etc/pve fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other 0 0
beancounter /proc/vz/beancounter cgroup rw,relatime,blkio,name=beancounter 0 0
container /proc/vz/container cgroup rw,relatime,freezer,devices,name=container 0 0
fairsched /proc/vz/fairsched cgroup rw,relatime,cpuacct,cpu,cpuset,name=fairsched 0 0
/var/lib/vz/private/100 /var/lib/vz/root/100 simfs rw,relatime,usrquota,grpquota 0 0
/mnt/nadb /var/lib/vz/root/100/var/lib/mysql simfs rw,relatime 0 0
proc /var/lib/vz/root/100/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/100/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/dev devtmpfs rw,nosuid,noexec,relatime,size=6389760k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/100/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/101 /var/lib/vz/root/101 simfs rw,relatime,usrquota,grpquota 0 0
/mnt/hhdb /var/lib/vz/root/101/var/lib/mysql simfs rw,relatime 0 0
proc /var/lib/vz/root/101/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/101/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/run tmpfs rw,nosuid,noexec,relatime,size=1277952k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/100/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1597440 0 0
none /var/lib/vz/root/100/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2975320k,nr_inodes=1597440 0 0
none /var/lib/vz/root/100/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/dev devtmpfs rw,nosuid,noexec,relatime,size=6389760k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/102 /var/lib/vz/root/102 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/102/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/102/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/101/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/101/run tmpfs rw,nosuid,noexec,relatime,size=1277952k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1597440 0 0
none /var/lib/vz/root/101/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2975320k,nr_inodes=1597440 0 0
none /var/lib/vz/root/101/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/102/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/102/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/103/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/103/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/102/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/102/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/102/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/102/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/102/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/103/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/103/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/104 /var/lib/vz/root/104 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/104/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/104/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/103/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/103/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web1/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web2/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web4/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web5/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web6/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web8/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web13/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web14/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web17/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web18/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web19/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web20/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web23/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web27/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web28/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client4/web29/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client4/web30/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web31/log simfs rw,relatime,usrquota,grpquota 0 0
none /var/lib/vz/root/103/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/103/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/103/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
none /var/lib/vz/root/104/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/104/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/104/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/104/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0



But it's all ok with Inodes, I can see how many files are there.

So if there's anything I need to install or just vzquota doesn't support XFS?

The main vz.conf:

Code:
## Global parameters
VIRTUOZZO=yes
LOCKDIR=/var/lib/vz/lock
DUMPDIR=/var/lib/vz/dump
VE0CPUUNITS=1000

## Logging parameters
LOGGING=yes
LOGFILE=/var/log/vzctl.log
LOG_LEVEL=0
VERBOSE=0

## Disk quota parameters
DISK_QUOTA=yes
VZFASTBOOT=no

# Disable module loading. If set, vz initscript does not load any modules.
#MODULES_DISABLED=yes

# The name of the device whose IP address will be used as source IP for CT.
# By default automatically assigned.
#VE_ROUTE_SRC_DEV="eth0"

# Controls which interfaces to send ARP requests and modify ARP tables on.
NEIGHBOUR_DEVS=detect

## Fail if there is another machine in the network with the same IP
ERROR_ON_ARPFAIL="no"

## Template parameters
TEMPLATE=/var/lib/vz/template

## Defaults for containers
VE_ROOT=/var/lib/vz/root/$VEID
VE_PRIVATE=/var/lib/vz/private/$VEID

## Filesystem layout for new CTs: either simfs (default) or ploop
#VE_LAYOUT=ploop

## Load vzwdog module
VZWDOG="no"

## IPv4 iptables kernel modules to be enabled in CTs by default
IPTABLES="ipt_REJECT ipt_tos ipt_limit ipt_multiport iptable_filter iptable_mangle ipt_TCPMSS ipt_tcpmss ipt_ttl ipt_length"
## IPv4 iptables kernel modules to be loaded by init.d/vz script
IPTABLES_MODULES="$IPTABLES"

## Enable IPv6
IPV6="yes"

## IPv6 ip6tables kernel modules
IP6TABLES="ip6_tables ip6table_filter ip6table_mangle ip6t_REJECT"



The one of my VPS config looks like that:
Code:
ONBOOT="yes"

PHYSPAGES="0:8192M"
SWAPPAGES="0:2048M"
KMEMSIZE="3723M:4096M"
DCACHESIZE="1861M:2048M"
LOCKEDPAGES="4096M"
PRIVVMPAGES="unlimited"
SHMPAGES="unlimited"
NUMPROC="unlimited"
VMGUARPAGES="0:unlimited"
OOMGUARPAGES="0:unlimited"
NUMTCPSOCK="unlimited"
NUMFLOCK="unlimited"
NUMPTY="unlimited"
NUMSIGINFO="unlimited"
TCPSNDBUF="unlimited"
TCPRCVBUF="unlimited"
OTHERSOCKBUF="unlimited"
DGRAMRCVBUF="unlimited"
NUMOTHERSOCK="unlimited"
NUMFILE="unlimited"
NUMIPTENT="unlimited"

# Disk quota parameters (in form of softlimit:hardlimit)
DISKSPACE="1000G:1100G"
DISKINODES="200000000:220000000"
QUOTATIME="0"
QUOTAUGIDLIMIT="10000"

# CPU fair scheduler parameter
CPUUNITS="1000"
CPUS="4"
HOSTNAME="server1.ispconfig.lt"
SEARCHDOMAIN="ispconfig.lt"
NAMESERVER="5.199.160.160"
IP_ADDRESS="5.199.163.8"
VE_ROOT="/var/lib/vz/root/$VEID"
VE_PRIVATE="/var/lib/vz/private/103"
OSTEMPLATE="debian-7.0-x86_64-minimal.tar.gz"

Most of them are similar. Previously I was running CentOS6 with OpenVZ kernel and ext4 and quota display and count was fine, the problem came after I switched to LVM, XFS and Proxmox. I really appreciate for the reply and help.

P.S.

Seems OpenVZ doesn't support XFS quotas, thanks for spirit for replay:
Hi,
openvz quotas is not supported on xfs. Proxmox default fs is ext3


https://openvz.org/Disk_quota
"
Filesystem dependency

If your host filesystem is not ext2/3/4 (like XFS) the disk quotas will not work inside containers.
"

I did shut down quota in /etc/vz/vz.conf by changing line to:
DISK_QUOTA=no

than restart vz service:
service vz restart

Hope support will be enabled one day.
 
Last edited: