[SOLVED] Upload Button Greyed Out on ZFS pool

[d90]

I recently set up proxmox on a Dell T420. Proxmox is installed to the dual redundant 16gb SD cards, and I have a ZFS pool consisting of 4 3 tb drives in raidz where everything else is going to live.

When I add the zfs filesystems to Proxmox, the upload button is live for a moment, then greys out. I can't upload disk images or create vms. What did I do wrong?

root@pve:~# zfs list -r mypool
NAME         USED  AVAIL  REFER  MOUNTPOINT
mypool       854K  7.65T   140K  none
mypool/ISO   140K  7.65T   140K  /mnt/ISO
mypool/VMs   140K  7.65T   140K  /mnt/VMs

root@pve:~# pveversion -v
proxmox-ve: 5.1-25 (running kernel: 4.13.4-1-pve)
pve-manager: 5.1-36 (running version: 5.1-36/131401db)
pve-kernel-4.13.4-1-pve: 4.13.4-25
pve-kernel-4.10.17-2-pve: 4.10.17-20
libpve-http-server-perl: 2.0-6
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-15
qemu-server: 5.0-17
pve-firmware: 2.0-3
libpve-common-perl: 5.0-20
libpve-guest-common-perl: 2.0-13
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-16
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-2
pve-docs: 5.1-12
pve-qemu-kvm: 2.9.1-2
pve-container: 2.0-17
pve-firewall: 3.0-3
pve-ha-manager: 2.0-3
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.0-2
lxcfs: 2.0.7-pve4
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.2-pve1~bpo90

root@pve:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        content vztmpl,iso,backup

lvmthin: local-lvm
        thinpool data
        vgname pve
        content rootdir,images

zfspool: VMs
        pool mypool/VMs
        content rootdir,images
        nodes pve
        sparse 0

zfspool: ISO
        pool mypool/ISO
        content rootdir,images
        nodes pve
        sparse 0

zfspool: mypool
        pool mypool
        content images,rootdir
        sparse 0

 

[mbaldini]

To upload ISO and LXC templates, you need a directory so you should add a storage as Directory

 

[d90]

To upload ISO and LXC templates, you need a directory so you should add a storage as Directory

I'm pretty sure the storage has a directory. when I df -h i have

root@pve:/mnt# df -h
Filesystem            Size  Used Avail Use% Mounted on
udev                   24G     0   24G   0% /dev
tmpfs                 4.8G  9.5M  4.8G   1% /run
/dev/mapper/pve-root  3.4G  1.9G  1.4G  59% /
tmpfs                  24G   43M   24G   1% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
tmpfs                  24G     0   24G   0% /sys/fs/cgroup
mypool/ISO            7.7T  128K  7.7T   1% /mnt/ISO
mypool/VMs            7.7T  128K  7.7T   1% /mnt/VMs
/dev/fuse              30M   16K   30M   1% /etc/pve
tmpfs                 4.8G     0  4.8G   0% /run/user/0

 

[jeffwadsworth]

What does this command show? blkid

 

[mbaldini]

I'm pretty sure the storage has a directory. when I df -h i have

Yes, zfs assign a directory to every zvol, however in pve storage.conf you don't have have defined them, in fact you have

zfspool: ISO
pool mypool/ISO
content rootdir,images
nodes pve
sparse 0

If you want a storage dir, you have to add it as directory (in Datacenter - Storage - Add choose directory)

 

[d90]

Thanks all. Now I'm wondering: Where are my VM's going when I have ZFS pool mypool/VMs chosen for the storage. If I browse that via SSH i see no vm's. how do i know where my vms' are living?

 

[d90]

What does this command show? blkid

/dev/sda1: LABEL="mypool" UUID="1494642372229857560" UUID_SUB="363940747350925152" TYPE="zfs_member" PARTLABEL="zfs-3bad703bb22c99c9" PARTUUID="1f5e1ea2-b8f7-6d49-a88b-7c4725413036"
/dev/sdb1: LABEL="mypool" UUID="1494642372229857560" UUID_SUB="8825961495339278843" TYPE="zfs_member" PARTLABEL="zfs-81d49c162982ef12" PARTUUID="cfd0da66-45a7-0e4c-8d30-ae71a3e88ef2"
/dev/sdc1: LABEL="mypool" UUID="1494642372229857560" UUID_SUB="14980864350096911221" TYPE="zfs_member" PARTLABEL="zfs-057b933afffcfc74" PARTUUID="b09c8a0e-184f-1d4b-a7a3-93977252d00d"
/dev/sdd1: LABEL="mypool" UUID="1494642372229857560" UUID_SUB="5440089300117390015" TYPE="zfs_member" PARTLABEL="zfs-30eed761345f064a" PARTUUID="93d18b60-aee5-e54f-9f71-55c2c7fd86f5"
/dev/sde2: UUID="323C-4D4F" TYPE="vfat" PARTUUID="1235c9c8-9a4c-4160-b08a-a6e7272debc2"
/dev/sde3: UUID="ZmU4X6-l7QT-QAKi-rONt-B60i-1lVD-PsScEw" TYPE="LVM2_member" PARTUUID="3e517ff5-a974-4739-8d9a-fa3b5ba18666"
/dev/mapper/pve-root: UUID="74232aff-1724-4d77-9bd4-af99aa8e51b8" TYPE="ext4"
/dev/mapper/pve-swap: UUID="4a884199-8393-4a37-bcb2-70e2b2512e32" TYPE="swap"
/dev/sda9: PARTUUID="a81d4bff-bf59-de48-9de7-b3a9c1d89d0c"
/dev/sdb9: PARTUUID="6891ca97-74a7-f643-ae2b-2299f81260d9"
/dev/sdc9: PARTUUID="c4921cce-00d0-f640-bd3d-09adb947c1a3"
/dev/sdd9: PARTUUID="b7b2a8ba-5f61-8546-ab80-820fbf6e309e"
/dev/sde1: PARTUUID="89970a49-8d56-4981-af04-63ea655ec837"
/dev/zd0: PTUUID="7b32e23b" PTTYPE="dos"
/dev/zd16: PTUUID="5ce20d0d" PTTYPE="dos"

 

[mbaldini]

Thanks all. Now I'm wondering: Where are my VM's going when I have ZFS pool mypool/VMs chosen for the storage. If I browse that via SSH i see no vm's. how do i know where my vms' are living?

See output of zfs list

 

[d90]

See output of zfs list

OK. I see this now:

> zfs list                                                                ~@pve
NAME                       USED  AVAIL  REFER  MOUNTPOINT
mypool                     181G  7.48T   140K  none
mypool/ISO                5.76G  7.48T  5.76G  /mnt/ISO
mypool/VMs                 175G  7.48T   140K  /mnt/VMs
mypool/VMs/vm-100-disk-1  72.2G  7.54T  4.90G  -
mypool/VMs/vm-101-disk-1   103G  7.56T  13.8G  -

If mypool/VMs is mounted to /mnt/VMs, why don't the disks show there?

 

[mbaldini]

Zfs can directly provide a volume (block device) to be used as disk for virtual machines. You can't see files because there is no file