Ghost VM disk?

[fuzzyduck]

Where is my file?

I have a VM with disk: VMdisks:vm-201-disk-0,size=32G

I check VMdisks storage and see the disk in the list(only VM running at the moment so just that one.

I check datacenter storage for location which is a ZFS type. TANK/proxmox/VMdisks

I do a zfs list | grep VMdisks and get:

root@pve:~# zfs list | grep VMdisks
TANK/proxmox/VMdisks                    33.0G  3.60T       96K  /TANK/proxmox/VMdisks
TANK/proxmox/VMdisks/vm-201-disk-0      33.0G  3.62T     15.4G  -
root@pve:~#

I start a shell and do an ls in the actual dir:

root@pve:/TANK/proxmox/VMdisks# ls
root@pve:/TANK/proxmox/VMdisks#

I do a find in the root of the zpool TANK:

root@pve:/# cd /TANK/
root@pve:/TANK# find . -name "*vm-201*"
root@pve:/TANK#

The VM is running so where is my disk file?

 

[oguz]

hi,

could you post your storage configuration cat /etc/pve/storage.cfg file, and also the full output from zfs list?

also what do you get from ls -alR /TANK?

 

[fuzzyduck]

hi,

could you post your storage configuration cat /etc/pve/storage.cfg file, and also the full output from zfs list?

also what do you get from ls -alR /TANK?

thank you for responding. Here is your requested info:

dir: local
        path /var/lib/vz
        content backup,vztmpl,snippets,iso
        shared 0

zfspool: local-zfs
        pool rpool/data
        content rootdir,images
        sparse 1

zfspool: CTdisks
        pool TANK/proxmox/CTdisks
        content rootdir
        mountpoint /TANK/proxmox/CTdisks
        sparse 0

zfspool: VMdisks
        pool TANK/proxmox/VMdisks
        content images
        mountpoint /TANK/proxmox/VMdisks
        sparse 0

dir: templates
        path /TANK/proxmox/templates
        content vztmpl
        prune-backups keep-all=1
        shared 0

dir: iso
        path /TANK/proxmox/iso
        content iso
        prune-backups keep-all=1
        shared 0

cifs: BackupDisk1
        path /mnt/pve/BackupDisk1
        server 192.168.1.105
        share 6TBbackupDisk1
        content backup
        prune-backups keep-daily=7,keep-monthly=1
        username root

cifs: BackupDisk2
        path /mnt/pve/BackupDisk2
        server 192.168.1.105
        share 6TBbackupDisk2
        content backup
        prune-backups keep-all=1
        username root

root@pve:/etc/pve# zfs list
NAME                                     USED  AVAIL     REFER  MOUNTPOINT
TANK                                    3.52T  3.61T     3.47T  /TANK
TANK/proxmox                            50.7G  3.61T      205M  /TANK/proxmox
TANK/proxmox/CTdisks                    17.5G  3.61T      176K  /TANK/proxmox/CTdisks
TANK/proxmox/CTdisks/subvol-100-disk-0  1.50G  2.50G     1.50G  /TANK/proxmox/CTdisks/subvol-100-disk-0
TANK/proxmox/CTdisks/subvol-101-disk-0  1004M  5.02G     1004M  /TANK/proxmox/CTdisks/subvol-101-disk-0
TANK/proxmox/CTdisks/subvol-102-disk-0  1.77G  6.23G     1.77G  /TANK/proxmox/CTdisks/subvol-102-disk-0
TANK/proxmox/CTdisks/subvol-103-disk-0  1.11G  6.89G     1.11G  /TANK/proxmox/CTdisks/subvol-103-disk-0
TANK/proxmox/CTdisks/subvol-104-disk-0  2.02G  5.98G     2.02G  /TANK/proxmox/CTdisks/subvol-104-disk-0
TANK/proxmox/CTdisks/subvol-105-disk-0  1.17G  6.83G     1.17G  /TANK/proxmox/CTdisks/subvol-105-disk-0
TANK/proxmox/CTdisks/subvol-106-disk-0  1.45G  6.55G     1.45G  /TANK/proxmox/CTdisks/subvol-106-disk-0
TANK/proxmox/CTdisks/subvol-107-disk-0  3.20G  12.8G     3.20G  /TANK/proxmox/CTdisks/subvol-107-disk-0
TANK/proxmox/CTdisks/subvol-110-disk-0   849M  3.17G      849M  /TANK/proxmox/CTdisks/subvol-110-disk-0
TANK/proxmox/CTdisks/subvol-111-disk-0  3.44G  12.6G     3.44G  /TANK/proxmox/CTdisks/subvol-111-disk-0
TANK/proxmox/VMdisks                    33.0G  3.61T       96K  /TANK/proxmox/VMdisks
TANK/proxmox/VMdisks/vm-201-disk-0      33.0G  3.62T     15.4G  -
rpool                                   1.33G   222G      104K  /rpool
rpool/ROOT                              1.29G   222G       96K  /rpool/ROOT
rpool/ROOT/pve-1                        1.29G   222G     1.29G  /
rpool/data                               152K   222G       96K  /rpool/data
rpool/data/vm-201-disk-0                  56K   222G       56K  -
root@pve:/etc/pve#

ls -alR /TANK | grep vm-201 gives me nothing.

The dir exists apparently but its not seen in shell.

I can also backup the VM with no problem. I might recreate the zfs storage though. first move to other location then zfs destroy?
It might work but i would like to know the reason

 

[oguz]

the zfs disk blockdevice is just not mounted. can you see the device in /dev/?
try running find /dev | grep 201 and you should find it.

Where is my file?

what do you want to do with it?

 

[fuzzyduck]

the zfs disk is just not mounted. can you see the device in /dev/?
try running find /dev | grep 201 and you should find it.


what do you want to do with it?

nothing

but how can i fix this? I just used zfs create TANK/proxmox/VMdisks. The same as the other one CTdisks, which shows up fine.

is there a mount all or something i can use? Sorry im a bit new to this. learning as i go

root@pve:/TANK/proxmox/VMdisks# zfs get mountpoint TANK/proxmox/VMdisks
NAME                  PROPERTY    VALUE                  SOURCE
TANK/proxmox/VMdisks  mountpoint  /TANK/proxmox/VMdisks  default
root@pve:/TANK/proxmox/VMdisks#

root@pve:/TANK/proxmox/VMdisks# zfs mount
rpool/ROOT/pve-1                /
rpool                           /rpool
rpool/ROOT                      /rpool/ROOT
rpool/data                      /rpool/data
TANK                            /TANK
TANK/proxmox                    /TANK/proxmox
TANK/proxmox/CTdisks            /TANK/proxmox/CTdisks
TANK/proxmox/VMdisks            /TANK/proxmox/VMdisks
TANK/proxmox/CTdisks/subvol-100-disk-0  /TANK/proxmox/CTdisks/subvol-100-disk-0
TANK/proxmox/CTdisks/subvol-101-disk-0  /TANK/proxmox/CTdisks/subvol-101-disk-0
TANK/proxmox/CTdisks/subvol-102-disk-0  /TANK/proxmox/CTdisks/subvol-102-disk-0
TANK/proxmox/CTdisks/subvol-103-disk-0  /TANK/proxmox/CTdisks/subvol-103-disk-0
TANK/proxmox/CTdisks/subvol-104-disk-0  /TANK/proxmox/CTdisks/subvol-104-disk-0
TANK/proxmox/CTdisks/subvol-105-disk-0  /TANK/proxmox/CTdisks/subvol-105-disk-0
TANK/proxmox/CTdisks/subvol-106-disk-0  /TANK/proxmox/CTdisks/subvol-106-disk-0
TANK/proxmox/CTdisks/subvol-107-disk-0  /TANK/proxmox/CTdisks/subvol-107-disk-0
TANK/proxmox/CTdisks/subvol-110-disk-0  /TANK/proxmox/CTdisks/subvol-110-disk-0
TANK/proxmox/CTdisks/subvol-111-disk-0  /TANK/proxmox/CTdisks/subvol-111-disk-0
root@pve:/TANK/proxmox/VMdisks#

 

[oguz]

nothing

no output from find? that's weird, you should be able to see it there...
or do you mean you don't want to do anything with the file?

The same as the other one CTdisks, which shows up fine.

it's normal for CT disks to show up as mounted. VM disks are taken as a blockdevice inside the VM and mounted by the guest OS.

 

[fuzzyduck]

no output from find? that's weird, you should be able to see it there...
or do you mean you don't want to do anything with the file?

it's normal for CT disks to show up as mounted. VM disks are taken as a blockdevice inside the VM and mounted by the guest OS.

Sorry for the confusion. I see it in /dev indeed. But i would like to see it in shell, just so i understand etc. Or is it normal for proxmox to 'hide' it?

and thank you for making time to respond to my question!

 

[oguz]

I see it in /dev indeed. But i would like to see it in shell, just so i understand etc. Or is it normal for proxmox to 'hide' it?

for containers, a zfs disk is a dataset/subvolume which has no partition table.
for VMs, it's a blockdevice (like /dev/sda). the guest OS will create its own partition table inside it, and filesystem. this acts similar to a physical disk.

i'm not sure what you mean by i would like to see it in shell. if you want to mount the disk to see the contents, you can do that (but don't mount it while the VM is using it!).

you can even mount the separate partitions.

to see partitions you can use fdisk -l /dev/zvol/.... and you can mount them normally with the mount command. (don't forget to unmount when you're done)

 

[fuzzyduck]

thank you! I thought i had messed something up

 

[oguz]

great, you can mark the thread as [SOLVED]