[SOLVED] problem mount /dev/sda1 on new install Proxmox 4.1

[AlexSay]

Hi!

i read some years this forum, but register only for subscribe my problem =(
search on google and forum - do not help
i try reinstall - but problem goin again

i setup proxmox in test usage on usb flash drive over clean debian 8.2 setup by manual on wiki
http://pve.proxmox.com/wiki/Install_Proxmox_VE_on_Debian_Jessie
evrething goin Ok - setup, update
proxmox system boot from flash - and accessible from https://192.168.1.33:8006/

but, when i try manual or fstab mount my sata hdd already used witch proxmox 3.4 and 4.1 as local2 storage

mkdir -p /var/lib/vz2
mount -t ext4 /dev/sda1 /var/lib/vz2

i got strange message

>>mount: /dev/sda1 is already mounted or /var/lib/vz2 busy

can anyone help me to diagnose problem ? =)

Alexander



root@pve:/var/lib# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 0 10M 0% /dev
tmpfs 3.2G 8.9M 3.2G 1% /run
/dev/dm-0 6.1G 1.4G 4.7G 22% /
tmpfs 7.8G 25M 7.8G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/mapper/pve-data 945M 1.3M 918M 1% /var/lib/vz
tmpfs 100K 0 100K 0% /run/lxcfs/controllers
cgmfs 100K 0 100K 0% /run/cgmanager/fs
/dev/fuse 30M 16K 30M 1% /etc/pve
192.168.1.252:/nfs/Public/NFS 3.6T 1.9T 1.7T 53% /mnt/pve/nfs1
192.168.1.253:/mnt/HD/HD_a2/NFS 1.8T 1.2T 646G 65% /mnt/pve/nfs3




root@pve:/var/lib# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=2026154,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,relatime,size=3260352k,mode=755)
/dev/mapper/pve-root on / type ext4 (rw,noatime,errors=remount-ro,data=ordered)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /sys/fs/cgroup type tmpfs (rw,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset,clone_children)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event,release_agent=/run/cgmanager/agents/cgm-release-agent.perf_event)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb,release_agent=/run/cgmanager/agents/cgm-release-agent.hugetlb)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=22,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
mqueue on /dev/mqueue type mqueue (rw,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/mapper/pve-data on /var/lib/vz type ext4 (rw,noatime,data=ordered)
rpc_pipefs on /run/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/lxcfs/controllers type tmpfs (rw,relatime,size=100k,mode=700)
name=systemd on /run/lxcfs/controllers/name=systemd type cgroup (rw,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd)
cpuset on /run/lxcfs/controllers/cpuset type cgroup (rw,relatime,cpuset,clone_children)
cpu,cpuacct on /run/lxcfs/controllers/cpu,cpuacct type cgroup (rw,relatime,cpu,cpuacct)
blkio on /run/lxcfs/controllers/blkio type cgroup (rw,relatime,blkio)
memory on /run/lxcfs/controllers/memory type cgroup (rw,relatime,memory)
devices on /run/lxcfs/controllers/devices type cgroup (rw,relatime,devices)
freezer on /run/lxcfs/controllers/freezer type cgroup (rw,relatime,freezer)
net_cls,net_prio on /run/lxcfs/controllers/net_cls,net_prio type cgroup (rw,relatime,net_cls,net_prio)
perf_event on /run/lxcfs/controllers/perf_event type cgroup (rw,relatime,perf_event,release_agent=/run/cgmanager/agents/cgm-release-agent.perf_event)
hugetlb on /run/lxcfs/controllers/hugetlb type cgroup (rw,relatime,hugetlb,release_agent=/run/cgmanager/agents/cgm-release-agent.hugetlb)
/var/lib/lxcfs on /var/lib/lxcfs type fuse.lxcfs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)
cgmfs on /run/cgmanager/fs type tmpfs (rw,relatime,size=100k,mode=755)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)
192.168.1.252:/nfs/Public/NFS on /mnt/pve/nfs1 type nfs (rw,relatime,vers=3,rsize=32768,wsize=32768,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.1.252,mountvers=3,mountport=33787,mountproto=udp,local_lock=none,addr=192.168.1.252)
192.168.1.253:/mnt/HD/HD_a2/NFS on /mnt/pve/nfs3 type nfs (rw,relatime,vers=3,rsize=32768,wsize=32768,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.1.253,mountvers=3,mountport=36192,mountproto=udp,local_lock=none,addr=192.168.1.253)



root@pve:/var/lib# fdisk -l /dev/sd*

Disk /dev/sda: 465.8 GiB, 500107862016 bytes, 976773168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xcdd27982

Device Boot Start End Sectors Size Id Type
/dev/sda1 2048 976766975 976764928 465.8G 83 Linux

Disk /dev/sda1: 465.8 GiB, 500103643136 bytes, 976764928 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/sdb: 7.9 GiB, 8455716864 bytes, 16515072 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xa785683f

Device Boot Start End Sectors Size Id Type
/dev/sdb1 * 2048 499711 497664 243M 83 Linux
/dev/sdb2 501758 16513023 16011266 7.7G 5 Extended
/dev/sdb5 501760 16513023 16011264 7.7G 8e Linux LVM

Disk /dev/sdb1: 243 MiB, 254803968 bytes, 497664 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk /dev/sdb2: 1 KiB, 1024 bytes, 2 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device Boot Start End Sectors Size Id Type
/dev/sdb2p1 2 16011265 16011264 7.7G 8e Linux LVM

Disk /dev/sdb5: 7.7 GiB, 8197767168 bytes, 16011264 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes




PARTED
(parted) print all
Model: ATA WDC WD5003ABYX-0 (scsi)
Disk /dev/sda: 500GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Disk Flags:

Number Start End Size Type File system Flags
1 1049kB 500GB 500GB primary ext4


Model: Generic Flash Disk (scsi)
Disk /dev/sdb: 8456MB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Disk Flags:

Number Start End Size Type File system Flags
1 1049kB 256MB 255MB primary ext2 boot
2 257MB 8455MB 8198MB extended
5 257MB 8455MB 8198MB logical lvm


Model: Linux device-mapper (linear) (dm)
Disk /dev/mapper/pve-data: 1023MB
Sector size (logical/physical): 512B/512B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 1023MB 1023MB ext4


Model: Linux device-mapper (linear) (dm)
Disk /dev/mapper/pve-swap: 478MB
Sector size (logical/physical): 512B/512B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 478MB 478MB linux-swap(v1)


Model: Linux device-mapper (linear) (dm)
Disk /dev/mapper/pve-root: 6694MB
Sector size (logical/physical): 512B/512B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 6694MB 6694MB ext4



root@pve:/var/lib# blkid
/dev/sda1: UUID="d63f6f6e-bc14-d101-d013-6e6ebc14d101" TYPE="ext4" PARTUUID="cdd27982-01"
/dev/sdb1: UUID="70356a87-f1d6-4f3f-b3b1-530db620b5c7" TYPE="ext2" PARTUUID="a785683f-01"
/dev/sdb5: UUID="RU5nm2-3DZw-QSy0-LYbd-Q4O8-qe1c-pCkPM0" TYPE="LVM2_member" PARTUUID="a785683f-05"
/dev/mapper/pve-root: UUID="35200e80-1273-4b4f-b71f-cd2ddb0a70f1" TYPE="ext4"
/dev/mapper/pve-swap: UUID="94e5b0cc-97d0-4eb2-b685-c1c708bccadd" TYPE="swap"
/dev/mapper/pve-data: UUID="7d6a0283-6103-4112-a7db-b2855af755af" TYPE="ext4"

 

[windinternet]

Did you at one point maybe have mdraid on sda1? Does /proc/mdstat exist and show sda1?

 

[AlexSay]

no, i do not use mdraid

but

root@pve:/proc# cat mdstat
Personalities :
md126 : inactive sda[0]
243163136 blocks super external:/md127/0

md127 : inactive sda[0](S)
1082392 blocks super external:ddf

unused devices: <none>



root@pve:~# mdadm --detail /dev/md126
/dev/md126:
Container : /dev/md/ddf0, member 0
Raid Devices : 6
Total Devices : 1

State : active, FAILED, Not Started
Active Devices : 1
Working Devices : 1
Failed Devices : 0
Spare Devices : 0

Container GUID : 4C534920:20202020:80862925:00000000:436372E3:43638707
(LSI 10/29/15 16:02:27)
Seq : 00000029
Virtual Disks : 1

Number Major Minor RaidDevice State
0 8 0 0 active sync /dev/sda
2 0 0 2 removed
4 0 0 4 removed
6 0 0 6 removed
8 0 0 8 removed
10 0 0 10 removed
root@pve:~# mdadm --detail /dev/md127
/dev/md127:
Version : ddf
Raid Level : container
Total Devices : 1

Working Devices : 1

Container GUID : 4C534920:20202020:80862925:00000000:436372E3:43638707
(LSI 10/29/15 16:02:27)
Seq : 00000029
Virtual Disks : 1

Member Arrays : /dev/md126

Number Major Minor RaidDevice

0 8 0 - /dev/sda



but i create only ext4 partition for local2 storage and use on proxmox 3.4 and 4.1 on another bootable flash drives 4gb and 16gb without this problems

problem only on new fresh install over debian 8.2 =)

 

[AlexSay]

Your point me in right direction =0

mdadm --stop /dev/md126
mdadm --stop /dev/md127
mdadm --zero-superblock /dev/sda
reboot

and problem gone =)

Thank you!!!

 

[windinternet]

Ah, we crossed posts

There seems to be some ddf metadata on sda. I don't know yet, if that is the cause of not being able to mount sda1, but if lsblk shows a md126 or md127 attached under your sda1, then it is.

If so, you could try:

mdadm --stop md127
mdadm --remove md127

And try if you can mount, or md126 if it shows that under sda1 in the output of lsblk.

It may be that the 4.1 Proxmox has some udev rules that recognise these ddf superblocks. If this is so, maybe you can remove the superblock with a mdadm --zero-superblock, but I don't know if that is completely safe, see also http://serverfault.com/questions/535231/mdadm-zero-superblock-on-disks-with-other-partitions-on-them

 

[windinternet]

The support for these ddf containers must have been added recently to debian, can be that this superblock has gone unnoticed for a long time

That is why people disassembling an array should always zero the superblocks, kind of gives nasty suprises later on, if you don't.