Hello,
first I want to say hello for all community, I really enjoy Proxmox and I found it really useful. I do configured it and most of features are working out of the box, but I have one little problem with OpenVZ quota.
I'm using LVM based XFS partitions for all disks alongside software RAID1, all I can see is just total space, but 0 used (for /var/lib/vz/private/$ctid containers):
/proc/mounts/:
But it's all ok with Inodes, I can see how many files are there.
So if there's anything I need to install or just vzquota doesn't support XFS?
The main vz.conf:
The one of my VPS config looks like that:
Most of them are similar. Previously I was running CentOS6 with OpenVZ kernel and ext4 and quota display and count was fine, the problem came after I switched to LVM, XFS and Proxmox. I really appreciate for the reply and help.
P.S.
Seems OpenVZ doesn't support XFS quotas, thanks for spirit for replay:
I did shut down quota in /etc/vz/vz.conf by changing line to:
DISK_QUOTA=no
than restart vz service:
service vz restart
Hope support will be enabled one day.
first I want to say hello for all community, I really enjoy Proxmox and I found it really useful. I do configured it and most of features are working out of the box, but I have one little problem with OpenVZ quota.
I'm using LVM based XFS partitions for all disks alongside software RAID1, all I can see is just total space, but 0 used (for /var/lib/vz/private/$ctid containers):
Code:
root@node1:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 0 10M 0% /dev
tmpfs 2.4G 2.5M 2.4G 1% /run
/dev/mapper/pve-root 94G 9.1G 85G 10% /
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 4.7G 25M 4.7G 1% /run/shm
/dev/mapper/backup-backup 1.6T 320G 1.3T 20% /backup
/dev/md0 228M 25M 196M 12% /boot
/dev/mapper/pve-data 1.7T 724G 952G 44% /var/lib/vz
/dev/mapper/perseusdb-namuakcentai 25G 3.7G 22G 15% /mnt/nadb
/dev/mapper/perseusdb-homehighlights 25G 380M 25G 2% /mnt/hhdb
/dev/fuse 30M 24K 30M 1% /etc/pve
/var/lib/vz/private/100 500G 0 500G 0% /var/lib/vz/root/100
/mnt/nadb 25G 3.7G 22G 15% /var/lib/vz/root/100/var/lib/mysql
none 6.1G 4.0K 6.1G 1% /var/lib/vz/root/100/dev
/var/lib/vz/private/101 500G 0 500G 0% /var/lib/vz/root/101
/mnt/hhdb 25G 380M 25G 2% /var/lib/vz/root/101/var/lib/mysql
none 1.3G 1.2M 1.3G 1% /var/lib/vz/root/100/run
none 5.0M 0 5.0M 0% /var/lib/vz/root/100/run/lock
none 2.9G 0 2.9G 0% /var/lib/vz/root/100/run/shm
none 100M 0 100M 0% /var/lib/vz/root/100/run/user
none 6.1G 4.0K 6.1G 1% /var/lib/vz/root/101/dev
/var/lib/vz/private/102 952G 0 952G 0% /var/lib/vz/root/102
none 1.3G 1.2M 1.3G 1% /var/lib/vz/root/101/run
none 5.0M 0 5.0M 0% /var/lib/vz/root/101/run/lock
none 2.9G 0 2.9G 0% /var/lib/vz/root/101/run/shm
none 100M 0 100M 0% /var/lib/vz/root/101/run/user
none 4.0G 4.0K 4.0G 1% /var/lib/vz/root/102/dev
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103
none 820M 1.2M 819M 1% /var/lib/vz/root/102/run
none 5.0M 0 5.0M 0% /var/lib/vz/root/102/run/lock
none 2.0G 0 2.0G 0% /var/lib/vz/root/102/run/shm
none 100M 0 100M 0% /var/lib/vz/root/102/run/user
none 4.0G 4.0K 4.0G 1% /var/lib/vz/root/103/dev
/var/lib/vz/private/104 952G 0 952G 0% /var/lib/vz/root/104
none 820M 1.2M 819M 1% /var/lib/vz/root/103/run
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web1/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client2/web2/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web4/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client2/web5/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web6/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web8/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web13/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client2/web14/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client2/web17/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web18/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web19/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client2/web20/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web23/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web27/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client1/web28/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client4/web29/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client4/web30/log
/var/lib/vz/private/103 952G 0 952G 0% /var/lib/vz/root/103/var/www/clients/client2/web31/log
none 5.0M 4.0K 5.0M 1% /var/lib/vz/root/103/run/lock
none 2.0G 0 2.0G 0% /var/lib/vz/root/103/run/shm
none 100M 0 100M 0% /var/lib/vz/root/103/run/user
none 4.0G 4.0K 4.0G 1% /var/lib/vz/root/104/dev
none 820M 1.4M 818M 1% /var/lib/vz/root/104/run
none 5.0M 0 5.0M 0% /var/lib/vz/root/104/run/lock
none 2.0G 0 2.0G 0% /var/lib/vz/root/104/run/shm
none 100M 0 100M 0% /var/lib/vz/root/104/run/user
/proc/mounts/:
Code:
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,relatime,size=10240k,nr_inodes=3072445,mode=755 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,noexec,relatime,size=2459932k,mode=755 0 0
/dev/mapper/pve-root / xfs rw,relatime,attr2,delaylog,noquota 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
tmpfs /run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=4919860k 0 0
/dev/mapper/backup-backup /backup xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/md0 /boot ext2 rw,relatime,errors=continue 0 0
/dev/mapper/pve-data /var/lib/vz xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/mapper/perseusdb-namuakcentai /mnt/nadb xfs rw,relatime,attr2,delaylog,noquota 0 0
/dev/mapper/perseusdb-homehighlights /mnt/hhdb xfs rw,relatime,attr2,delaylog,noquota 0 0
rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
/dev/fuse /etc/pve fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other 0 0
beancounter /proc/vz/beancounter cgroup rw,relatime,blkio,name=beancounter 0 0
container /proc/vz/container cgroup rw,relatime,freezer,devices,name=container 0 0
fairsched /proc/vz/fairsched cgroup rw,relatime,cpuacct,cpu,cpuset,name=fairsched 0 0
/var/lib/vz/private/100 /var/lib/vz/root/100 simfs rw,relatime,usrquota,grpquota 0 0
/mnt/nadb /var/lib/vz/root/100/var/lib/mysql simfs rw,relatime 0 0
proc /var/lib/vz/root/100/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/100/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/dev devtmpfs rw,nosuid,noexec,relatime,size=6389760k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/100/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/101 /var/lib/vz/root/101 simfs rw,relatime,usrquota,grpquota 0 0
/mnt/hhdb /var/lib/vz/root/101/var/lib/mysql simfs rw,relatime 0 0
proc /var/lib/vz/root/101/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/101/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/100/run tmpfs rw,nosuid,noexec,relatime,size=1277952k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/100/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1597440 0 0
none /var/lib/vz/root/100/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2975320k,nr_inodes=1597440 0 0
none /var/lib/vz/root/100/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/dev devtmpfs rw,nosuid,noexec,relatime,size=6389760k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/102 /var/lib/vz/root/102 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/102/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/102/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/101/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/101/run tmpfs rw,nosuid,noexec,relatime,size=1277952k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/101/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1597440 0 0
none /var/lib/vz/root/101/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2975320k,nr_inodes=1597440 0 0
none /var/lib/vz/root/101/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1597440,mode=755 0 0
none /var/lib/vz/root/102/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/102/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/103/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/103/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/102/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/102/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/102/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/102/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/102/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/103/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/103/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/var/lib/vz/private/104 /var/lib/vz/root/104 simfs rw,relatime,usrquota,grpquota 0 0
proc /var/lib/vz/root/104/proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /var/lib/vz/root/104/sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/103/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/103/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web1/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web2/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web4/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web5/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web6/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web8/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web13/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web14/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web17/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web18/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web19/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web20/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web23/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web27/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client1/web28/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client4/web29/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client4/web30/log simfs rw,relatime,usrquota,grpquota 0 0
/var/lib/vz/private/103 /var/lib/vz/root/103/var/www/clients/client2/web31/log simfs rw,relatime,usrquota,grpquota 0 0
none /var/lib/vz/root/103/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/103/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/103/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/dev devtmpfs rw,nosuid,noexec,relatime,size=4194304k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
none /var/lib/vz/root/104/proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
none /var/lib/vz/root/104/run tmpfs rw,nosuid,noexec,relatime,size=838864k,nr_inodes=1048576,mode=755 0 0
none /var/lib/vz/root/104/run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=1048576 0 0
none /var/lib/vz/root/104/run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=2097140k,nr_inodes=1048576 0 0
none /var/lib/vz/root/104/run/user tmpfs rw,nosuid,nodev,noexec,relatime,size=102400k,nr_inodes=1048576,mode=755 0 0
But it's all ok with Inodes, I can see how many files are there.
So if there's anything I need to install or just vzquota doesn't support XFS?
The main vz.conf:
Code:
## Global parameters
VIRTUOZZO=yes
LOCKDIR=/var/lib/vz/lock
DUMPDIR=/var/lib/vz/dump
VE0CPUUNITS=1000
## Logging parameters
LOGGING=yes
LOGFILE=/var/log/vzctl.log
LOG_LEVEL=0
VERBOSE=0
## Disk quota parameters
DISK_QUOTA=yes
VZFASTBOOT=no
# Disable module loading. If set, vz initscript does not load any modules.
#MODULES_DISABLED=yes
# The name of the device whose IP address will be used as source IP for CT.
# By default automatically assigned.
#VE_ROUTE_SRC_DEV="eth0"
# Controls which interfaces to send ARP requests and modify ARP tables on.
NEIGHBOUR_DEVS=detect
## Fail if there is another machine in the network with the same IP
ERROR_ON_ARPFAIL="no"
## Template parameters
TEMPLATE=/var/lib/vz/template
## Defaults for containers
VE_ROOT=/var/lib/vz/root/$VEID
VE_PRIVATE=/var/lib/vz/private/$VEID
## Filesystem layout for new CTs: either simfs (default) or ploop
#VE_LAYOUT=ploop
## Load vzwdog module
VZWDOG="no"
## IPv4 iptables kernel modules to be enabled in CTs by default
IPTABLES="ipt_REJECT ipt_tos ipt_limit ipt_multiport iptable_filter iptable_mangle ipt_TCPMSS ipt_tcpmss ipt_ttl ipt_length"
## IPv4 iptables kernel modules to be loaded by init.d/vz script
IPTABLES_MODULES="$IPTABLES"
## Enable IPv6
IPV6="yes"
## IPv6 ip6tables kernel modules
IP6TABLES="ip6_tables ip6table_filter ip6table_mangle ip6t_REJECT"
The one of my VPS config looks like that:
Code:
ONBOOT="yes"
PHYSPAGES="0:8192M"
SWAPPAGES="0:2048M"
KMEMSIZE="3723M:4096M"
DCACHESIZE="1861M:2048M"
LOCKEDPAGES="4096M"
PRIVVMPAGES="unlimited"
SHMPAGES="unlimited"
NUMPROC="unlimited"
VMGUARPAGES="0:unlimited"
OOMGUARPAGES="0:unlimited"
NUMTCPSOCK="unlimited"
NUMFLOCK="unlimited"
NUMPTY="unlimited"
NUMSIGINFO="unlimited"
TCPSNDBUF="unlimited"
TCPRCVBUF="unlimited"
OTHERSOCKBUF="unlimited"
DGRAMRCVBUF="unlimited"
NUMOTHERSOCK="unlimited"
NUMFILE="unlimited"
NUMIPTENT="unlimited"
# Disk quota parameters (in form of softlimit:hardlimit)
DISKSPACE="1000G:1100G"
DISKINODES="200000000:220000000"
QUOTATIME="0"
QUOTAUGIDLIMIT="10000"
# CPU fair scheduler parameter
CPUUNITS="1000"
CPUS="4"
HOSTNAME="server1.ispconfig.lt"
SEARCHDOMAIN="ispconfig.lt"
NAMESERVER="5.199.160.160"
IP_ADDRESS="5.199.163.8"
VE_ROOT="/var/lib/vz/root/$VEID"
VE_PRIVATE="/var/lib/vz/private/103"
OSTEMPLATE="debian-7.0-x86_64-minimal.tar.gz"
Most of them are similar. Previously I was running CentOS6 with OpenVZ kernel and ext4 and quota display and count was fine, the problem came after I switched to LVM, XFS and Proxmox. I really appreciate for the reply and help.
P.S.
Seems OpenVZ doesn't support XFS quotas, thanks for spirit for replay:
Hi,
openvz quotas is not supported on xfs. Proxmox default fs is ext3
https://openvz.org/Disk_quota
"
Filesystem dependency
If your host filesystem is not ext2/3/4 (like XFS) the disk quotas will not work inside containers.
"
I did shut down quota in /etc/vz/vz.conf by changing line to:
DISK_QUOTA=no
than restart vz service:
service vz restart
Hope support will be enabled one day.
Last edited: