Error adding zfs pool on a new cluster node

[yena]

Hello, i have added a cluster node ( proxmox 5 no shared storage ), than i'm creating the pool:

zpool create -f -o ashift=12 STORAGE mirror /dev/sdc /dev/sdd
mountpoint '/STORAGE' exists and is not empty
use '-m' option to provide a different default
root@cvs7:~# zfs list
NAME USED AVAIL REFER MOUNTPOINT
rpool 9.79G 215G 104K /rpool
rpool/ROOT 1.28G 215G 96K /rpool/ROOT
rpool/ROOT/pve-1 1.28G 215G 1.28G /
rpool/data 96K 215G 96K /rpool/data
rpool/swap 8.50G 223G 56K -

How can i create the pool after adding the node ?
Have i to remove the node, reinstall, create the pool and than finaly add the node ?
( i have also tryed to remove the new node from the shared storage on datacenter )

Thanks!

 

[Stoiko Ivanov]

mountpoint '/STORAGE' exists and is not empty

Sounds like you already have some data in `/STORAGE`, check it with `ls -la /STORAGE`.
You'd need to move that data (or the whole directory) away before creating a zpool, which gets mounted on /STORAGE

 

[yena]

my new node is brand new, i have a Pool named STORAGE on other nodes...

 

[Stoiko Ivanov]

please post the output of:
* `ls -la /STORAGE`
* `pvesm status`
* `zpool list`
* `zpool status`
* `zfs list`

from that new node

 

[yena]

root@cvs7:~# ls -la /STORAGE
total 10
drwxr-xr-x 3 root root 3 Oct 19 11:39 .
drwxr-xr-x 25 root root 25 Oct 19 12:11 ..
drwxr-xr-x 3 root root 3 Oct 19 11:39 BACKUP
root@cvs7:~#
root@cvs7:~# pvesm status
Name Type Status Total Used Available %
BACKUP dir disabled 0 0 0 N/A
GREENFIT zfspool active 471334912 4299516 467035396 0.91%
KVM zfspool disabled 0 0 0 N/A
LXC zfspool disabled 0 0 0 N/A
local dir active 226749696 1346944 225402752 0.59%
local-zfs zfspool active 225402932 96 225402836 0.00%
root@cvs7:~#
root@cvs7:~# zpool list
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
GRBACKUP 3.62T 456K 3.62T - 0% 0% 1.00x ONLINE -
GREENFIT 464G 4.16G 460G - 0% 0% 1.00x ONLINE -
rpool 232G 1.29G 231G - 0% 0% 1.00x ONLINE -
root@cvs7:~#
root@cvs7:~# zpool status
pool: GRBACKUP
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
GRBACKUP ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
sde ONLINE 0 0 0
sdf ONLINE 0 0 0

errors: No known data errors

pool: GREENFIT
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
GREENFIT ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
sdc ONLINE 0 0 0
sdd ONLINE 0 0 0

errors: No known data errors

pool: rpool
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
rpool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
sda2 ONLINE 0 0 0
sdb2 ONLINE 0 0 0

errors: No known data errors
root@cvs7:~#
root@cvs7:~# zfs list
NAME USED AVAIL REFER MOUNTPOINT
GRBACKUP 348K 3.51T 96K /GRBACKUP
GREENFIT 4.25G 445G 96K /GREENFIT
GREENFIT/subvol-601-disk-1 4.25G 445G 4.25G /GREENFIT/subvol-601-disk-1
rpool 9.79G 215G 104K /rpool
rpool/ROOT 1.28G 215G 96K /rpool/ROOT
rpool/ROOT/pve-1 1.28G 215G 1.28G /
rpool/data 96K 215G 96K /rpool/data
rpool/swap 8.50G 223G 56K -

( while i'm posting we have created the new pool GREENFIT )
Maybe.. when i have added the node, the cluster have created the dir /STORAGE ... and so now i can't create the pool ..

 

[Stoiko Ivanov]

root@cvs7:~# ls -la /STORAGE
total 10
drwxr-xr-x 3 root root 3 Oct 19 11:39 .
drwxr-xr-x 25 root root 25 Oct 19 12:11 ..
drwxr-xr-x 3 root root 3 Oct 19 11:39 BACKUP

The folder BACKUP in /STORAGE prevents the pool from being created...

I guess you have defined the BACKUP dir-storage to point to /STORAGE/BACKUP?

PVE by default creates the directory for a dir-storage which doesn't exist (see `man pvesm` the option for is_mountpoint and mkdir)

You could try the following:
move the /STORAGE dir out of the way, create the zpool in the same command, and then let PVE create the directory storage for you:

mv /STORAGE /STORAGE.BCK && zpool create -f -o ashift=12 STORAGE mirror /dev/sdc /dev/sdd