changed nfs server IP address, how to make pve notice/remount?

m.ardito

Active Member
Feb 17, 2010
1,473
16
38
Torino, Italy
Hi,

I know, I know, I should have asked before, but I felt I could find a way to sove this anyway...
I had to change nfs server IP address, and pve cluster had nfs ad iscsi resource on this mounted... (not active, of course just mounted)

one of the nodes was empty so I just rebooted and now it sees the same nfs/iscsi resourses content fine.

other node has lots of running vms... is there any way to remount those nfs without rebooting the node?

update:

what about
#pvesm set STORAGENAME -server NEWIP
?

Thanks,
Marco
 
Last edited:
other node has lots of running vms... is there any way to remount those nfs without rebooting the node?

Simply 'umount' the nfs directory. It is automatically re-mounted if you access the storage with the pve GUI.
 
Simply 'umount' the nfs directory. It is automatically re-mounted if you access the storage with the pve GUI.

that didn't worked... it said it was busy (but it wasn't really). even -f did not work, so I did a lazy unmount
but then the gui show weird state of the node. and entering those shares on gui did not remount them...

so i tried what suggested here...
http://forum.proxmox.com/threads/16747-Rebooting-ProxMox-Node

now it seems ok, I will test further... that for nfs.

now it seems the only problem is on iscsi on another server (not the one that changed ip)... this has running vm disk on lvm... gui shows those disks, but if I look at that iscsi mount, nothing is shown, no LUN info...

on the other hand the iscsi on the server that changed ip now is showing its LUN info normally...

?!?

Marco
 
...after a night, this is the situation:

all nfs shares are ok. lvm + iscsi on the same server (changed ip) is ok.
ok means: works on the cli, on the gui, pvesm list,

but now something weird is happening for another iscsi: this has all vm disk running on its lvm storage

from all nodes i get

Code:
# pvesm status
iso_qnap          nfs 1     10084223488      5302334720      4781888768 53.08%
local             dir 1        34116380        28047268         6069112 82.71%
pve_ts879         nfs 1     11619394112      1482127296     10136480384 13.26%
ts879             nfs 1     11619394112      1482127296     10136480384 13.26%
vm_disks          lvm 1      1048571904               0       392986624 0.50%
vm_disks_ts879    lvm 0               0               0               0 100.00%
vm_ts879        iscsi 1               0               0               0 100.00%
vm_work         iscsi 1               0               0               0 100.00%

but about the serever that didn't change ip:

from /etc/pve/storage.cfg:
Code:
iscsi: [B]vm_work[/B]
               target iqn.2004-04.com.qnap:ts-809u:iscsi.pve2.c0a765
               portal 192.168.3.30
               content none

lvm: [B]vm_disks[/B]
        vgname pve_vm_disks
        base [B]vm_work[/B]:0.0.0.scsi-36001405ed36201adab64d4b0ad8e4cd2
        shared
        content images

but

Code:
# pvesm iscsiscan -portal 192.168.3.30
iqn.2004-04.com.qnap:ts-809u:iscsi.pve.c0a765              192.168.3.30:3260
iqn.2004-04.com.qnap:ts-809u:iscsi.pve2.c0a765             192.168.3.30:3260
iqn.2004-04.com.qnap:ts-809u:iscsi.landrives.c0a765        192.168.3.30:3260
iqn.2004-04.com.qnap:ts-809u:iscsi.pvelvmtest.c0a765       192.168.3.30:3260
iqn.2004-04.com.qnap:ts-809u:iscsi.hpopenviewdisk01.c0a765 192.168.3.30:3260

# pvesm list vm_work: no output (?!?)

# pvesm list vm_disks
vm_disks:vm-101-disk-2   raw 34359738368 101
vm_disks:vm-102-disk-1   raw 12884901888 102
vm_disks:vm-103-disk-1   raw 17179869184 103
vm_disks:vm-103-disk-2   raw 1073741824 103
....(35 vm disks)

and there are more then 15 vm (kvm) working on this iscsi...

Code:
# vgs
  VG                 #PV #LV #SN Attr   VSize    VFree
  pve                  1   3   0 wz--n-   66.55g    8.37g
  pve_vm_disks         1  34   0 wz--n- 1000.00g  374.78g
  pve_vm_disks_ts879   1   0   0 wz--n- 1000.00g 1000.00g


# lvs
  LV            VG           Attr      LSize  Pool Origin Data%  Move Log Copy%  Convert
  data          pve          -wi-ao--- 33.05g
  root          pve          -wi-ao--- 16.75g
  swap          pve          -wi-ao---  8.38g
  vm-101-disk-2 pve_vm_disks -wi-ao--- 32.00g
  vm-102-disk-1 pve_vm_disks -wi------ 12.00g
  vm-103-disk-1 pve_vm_disks -wi------ 16.00g
  vm-103-disk-2 pve_vm_disks -wi------  1.00g
  vm-104-disk-2 pve_vm_disks -wi------ 32.00g
  vm-105-disk-2 pve_vm_disks -wi------ 32.00g
  vm-105-disk-3 pve_vm_disks -wi------ 32.00g
  vm-109-disk-1 pve_vm_disks -wi------  8.02g
  vm-109-disk-2 pve_vm_disks -wi------  8.02g
  vm-200-disk-1 pve_vm_disks -wi------  8.00g
  vm-202-disk-1 pve_vm_disks -wi------  8.01g
  vm-202-disk-2 pve_vm_disks -wi------  8.01g
  vm-203-disk-1 pve_vm_disks -wi------  8.01g
  vm-203-disk-2 pve_vm_disks -wi------  8.01g
  vm-204-disk-1 pve_vm_disks -wi------  8.01g
  vm-205-disk-1 pve_vm_disks -wi------ 80.00g
  vm-206-disk-1 pve_vm_disks -wi------  5.01g
  vm-206-disk-2 pve_vm_disks -wi------ 15.00g
  vm-207-disk-1 pve_vm_disks -wi------ 12.01g
  vm-207-disk-2 pve_vm_disks -wi------ 12.01g
  vm-209-disk-1 pve_vm_disks -wi------ 32.00g
  vm-211-disk-1 pve_vm_disks -wi------ 32.01g
  vm-216-disk-1 pve_vm_disks -wi------  8.00g
  vm-300-disk-1 pve_vm_disks -wi------  8.01g
  vm-300-disk-2 pve_vm_disks -wi------  8.01g
  vm-301-disk-1 pve_vm_disks -wi------  8.01g
  vm-301-disk-2 pve_vm_disks -wi------  8.01g
  vm-302-disk-1 pve_vm_disks -wi------ 32.00g
  vm-310-disk-1 pve_vm_disks -wi------ 32.00g
  vm-310-disk-2 pve_vm_disks -wi------ 32.00g
  vm-400-disk-1 pve_vm_disks -wi------  8.02g
  vm-400-disk-2 pve_vm_disks -wi------  8.02g
  vm-700-disk-1 pve_vm_disks -wi------ 32.00g
  vm-900-disk-1 pve_vm_disks -wi------ 32.00g



this means also that from gui if I try to add a LVM storage, vm_work is selectable but has no LUNs listed...

while for the other nss/iscsi server (this changed ip address)

from /etc/pve/storage.cfg:
Code:
iscsi: vm_ts879
        target iqn.2004-04.com.qnap:ts-879u-rp:iscsi.pve.d4e6fc
        portal 172.16.0.3
        content none

lvm: vm_disks_ts879
        vgname pve_vm_disks_ts879
        base vm_ts879:0.0.0.scsi-36001405c0d33887dd422d4f29d88b1d3
        shared
        content images

and

Code:
#pvesm iscsiscan -portal 172.16.0.3
iqn.2004-04.com.qnap:ts-879u-rp:iscsi.pve.d4e6fc 172.16.0.3:3260

# pvesm list vm_ts879
vm_ts879:0.0.0.scsi-36001405c0d33887dd422d4f29d88b1d3   raw 1073741824000

# pvesm list vm_disks_ts879 (no output but this is ok, since there' nothing yet here...

I am lost now...

Marco
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!