local disk "LVM", all other "mounted"? Is this ok?

K

KnowVation

Renowned Member
Proxmox Subscriber
Mar 19, 2015
93
0
71
Germany, Bavaria, Adelsdorf
www.knowvation.de
Hello!

I have created a new three nodes cluster with PVE 3.4 and ceph for the storage.
All works fine, but there is a little difference with the Disks where Proxmox is installed. All the three nodes have an 120 GB SSD Disk for the PVE 3.4 Operating System. And all nodes reboot without errors, all looks good.
On the first Node the local disk is "LVM" (thats right) and the other two nodes the local disk is "mounted".
Is this correct? No problems with reboot, but before i use this three nodes in our production i want to aks about this "problem". On my old Proxmox Installations the local disks on all nodes had "LVM".

Thanks and best regards,

Roman
 
Hi Udo!

Here is the storage.cfg:
Code: 
root@PVE01:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        content images,iso,vztmpl,rootdir
        maxfiles 0

nfs: BS01
        path /mnt/pve/BS01
        server 192.168.8.4
        export /media/ext_datastore01
        options vers=3
        content images,iso,vztmpl,rootdir,backup
        maxfiles 2

nfs: DiskStation
        path /mnt/pve/DiskStation
        server 192.168.8.25
        export /volume1/PROXMOX
        options vers=3
        content images,iso,vztmpl,rootdir,backup
        maxfiles 3

rbd: CephSSD
        monhost 10.10.10.0 10.10.10.1 10.10.10.2
        pool CephSSD
        content images
        username admin

nfs: InobaStation
        path /mnt/pve/InobaStation
        server 192.168.8.7
        export /volume1/PROXMOX
        options vers=3
        content images,iso,vztmpl,rootdir,backup
        maxfiles 2

root@PVE01:~#

And here are the lvs and mount on all three nodes:

lvs on PVE01:
Code: 
root@PVE01:~# lvs
  LV   VG   Attr      LSize  Pool Origin Data%  Move Log Copy%  Convert
  data pve  -wi-ao--- 56.17g
  root pve  -wi-ao--- 27.75g
  swap pve  -wi-ao--- 13.88g
root@PVE01:~#

mount on PVE01:

Code: 
root@PVE01:~# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=4102395,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=3284216k,mode=755)
/dev/mapper/pve-root on / type ext4 (rw,relatime,errors=remount-ro,barrier=1,data=ordered)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /run/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=6568420k)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/mapper/pve-data on /var/lib/vz type ext4 (rw,relatime,barrier=1,data=ordered)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)
none on /sys/kernel/config type configfs (rw,relatime)
/dev/sdc1 on /var/lib/ceph/osd/ceph-1 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
/dev/sdb1 on /var/lib/ceph/osd/ceph-0 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
/dev/sdd1 on /var/lib/ceph/osd/ceph-2 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
beancounter on /proc/vz/beancounter type cgroup (rw,relatime,blkio,name=beancounter)
container on /proc/vz/container type cgroup (rw,relatime,freezer,devices,name=container)
fairsched on /proc/vz/fairsched type cgroup (rw,relatime,cpuacct,cpu,cpuset,name=fairsched)
192.168.8.4:/media/ext_datastore01 on /mnt/pve/BS01 type nfs (rw,relatime,vers=3,rsize=524288,wsize=524288,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.4,mountvers=3,mountport=33797,mountproto=udp,local_lock=none,addr=192.168.8.4)
192.168.8.25:/volume1/PROXMOX on /mnt/pve/DiskStation type nfs (rw,relatime,vers=3,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.25,mountvers=3,mountport=892,mountproto=udp,local_lock=none,addr=192.168.8.25)
192.168.8.7:/volume1/PROXMOX on /mnt/pve/InobaStation type nfs (rw,relatime,vers=3,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.7,mountvers=3,mountport=892,mountproto=udp,local_lock=none,addr=192.168.8.7)
root@PVE01:~#

lvs on PVE02:

Code: 
root@PVE02:~# lvs
  LV   VG   Attr      LSize  Pool Origin Data%  Move Log Copy%  Convert
  data pve  -wi-ao--- 56.17g
  root pve  -wi-ao--- 27.75g
  swap pve  -wi-ao--- 13.88g
root@PVE02:~#

mount on PVE02:

Code: 
root@PVE02:~# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=4102412,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=3284228k,mode=755)
/dev/mapper/pve-root on / type ext4 (rw,relatime,errors=remount-ro,barrier=1,data=ordered)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /run/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=6568440k)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/mapper/pve-data on /var/lib/vz type ext4 (rw,relatime,barrier=1,data=ordered)
/dev/sda2 on /boot/efi type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=cp437,iocharset=ascii,shortname=mixed,errors=remount-ro)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)
none on /sys/kernel/config type configfs (rw,relatime)
/dev/sdc1 on /var/lib/ceph/osd/ceph-4 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
/dev/sdd1 on /var/lib/ceph/osd/ceph-5 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
/dev/sdb1 on /var/lib/ceph/osd/ceph-3 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
beancounter on /proc/vz/beancounter type cgroup (rw,relatime,blkio,name=beancounter)
container on /proc/vz/container type cgroup (rw,relatime,freezer,devices,name=container)
fairsched on /proc/vz/fairsched type cgroup (rw,relatime,cpuacct,cpu,cpuset,name=fairsched)
192.168.8.4:/media/ext_datastore01 on /mnt/pve/BS01 type nfs (rw,relatime,vers=3,rsize=524288,wsize=524288,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.4,mountvers=3,mountport=33797,mountproto=udp,local_lock=none,addr=192.168.8.4)
192.168.8.25:/volume1/PROXMOX on /mnt/pve/DiskStation type nfs (rw,relatime,vers=3,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.25,mountvers=3,mountport=892,mountproto=udp,local_lock=none,addr=192.168.8.25)
192.168.8.7:/volume1/PROXMOX on /mnt/pve/InobaStation type nfs (rw,relatime,vers=3,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.7,mountvers=3,mountport=892,mountproto=udp,local_lock=none,addr=192.168.8.7)
root@PVE02:~#

lvs on PVE03:

Code: 
root@PVE03:~# lvs
  LV   VG   Attr      LSize  Pool Origin Data%  Move Log Copy%  Convert
  data pve  -wi-ao--- 56.17g
  root pve  -wi-ao--- 27.75g
  swap pve  -wi-ao--- 13.88g
root@PVE03:~#

mount on PVE03:
Code: 
root@PVE03:~# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=4102402,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=3284220k,mode=755)
/dev/mapper/pve-root on / type ext4 (rw,relatime,errors=remount-ro,barrier=1,data=ordered)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /run/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=6568420k)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/mapper/pve-data on /var/lib/vz type ext4 (rw,relatime,barrier=1,data=ordered)
/dev/sda2 on /boot/efi type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=cp437,iocharset=ascii,shortname=mixed,errors=remount-ro)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)
none on /sys/kernel/config type configfs (rw,relatime)
/dev/sdb1 on /var/lib/ceph/osd/ceph-6 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
/dev/sdc1 on /var/lib/ceph/osd/ceph-7 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
/dev/sdd1 on /var/lib/ceph/osd/ceph-8 type xfs (rw,noatime,attr2,delaylog,inode64,noquota)
beancounter on /proc/vz/beancounter type cgroup (rw,relatime,blkio,name=beancounter)
container on /proc/vz/container type cgroup (rw,relatime,freezer,devices,name=container)
fairsched on /proc/vz/fairsched type cgroup (rw,relatime,cpuacct,cpu,cpuset,name=fairsched)
192.168.8.4:/media/ext_datastore01 on /mnt/pve/BS01 type nfs (rw,relatime,vers=3,rsize=524288,wsize=524288,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.4,mountvers=3,mountport=33797,mountproto=udp,local_lock=none,addr=192.168.8.4)
192.168.8.25:/volume1/PROXMOX on /mnt/pve/DiskStation type nfs (rw,relatime,vers=3,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.25,mountvers=3,mountport=892,mountproto=udp,local_lock=none,addr=192.168.8.25)
192.168.8.7:/volume1/PROXMOX on /mnt/pve/InobaStation type nfs (rw,relatime,vers=3,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.8.7,mountvers=3,mountport=892,mountproto=udp,local_lock=none,addr=192.168.8.7)
root@PVE03:~#


Thanks in advance Udo,

Roman
 
Last edited:
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back