LVM/LUN's Suddenly missing

[HDmac]

I started up my proxmox server today and found that I cannot boot any of my VM's. All the iscsi disks don't seem to be working. Here is the output:

iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:pop-os]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:raspiblitz-os]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:raspiblitz-storage]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming-storage]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming-storage-slow]
iscsiadm: No records found
command '/usr/bin/iscsiadm --mode node --targetname iqn.2005-10.org.freenas.ctl:windows-gaming-storage-slow --login' failed: exit code 21
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:pop-os]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:raspiblitz-os]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:raspiblitz-storage]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming-storage]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming-storage-slow]
iscsiadm: No records found
command '/usr/bin/iscsiadm --mode node --targetname iqn.2005-10.org.freenas.ctl:windows-gaming --login' failed: exit code 21
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:pop-os]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:raspiblitz-os]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:raspiblitz-storage]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming-storage]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 10.0.0.2,3260,1 iqn.2005-10.org.freenas.ctl:windows-gaming-storage-slow]
iscsiadm: No records found
command '/usr/bin/iscsiadm --mode node --targetname iqn.2005-10.org.freenas.ctl:windows-gaming-storage --login' failed: exit code 21
TASK ERROR: volume 'windows-gaming-os:0.0.0.scsi-36589cfc0000004adf71d436ec6e3dccd' does not exist

When removing the hard disks and or iscsi targets trying to re-add, there are no volumes to select from anymore even though 'use lun directly' is checked.

 

[HDmac]

When I add a new disk using iscsi everything seems to work fine but trying to select existing target/LUN's doesn't work. Is there a way to reset this or delete the data associated with that?

 

[HDmac]

I was able to create a new target and use the existing extent on the iscsi server, everything booted fine. Seems to be an issue with the pre-existing LUN data being corrupt. I'd like to delete or restore it but I don't know where to look or what tools to use for that.

 

[colourreich]

Hello,

I'm seeing this same error after an unclean reboot (power loss). Did you discover what the problem was?

root@pve1:~# iscsiadm --mode discoverydb --type sendtargets --portal 172.20.0.20 --discover
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.20.0.20,3260,1 iqn.2005-10.org.freenas.ctl:f11]
iscsiadm: Could not stat /etc/iscsi/nodes//,3260,-1/default to delete node: No such file or directory
iscsiadm: Could not add/update [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.20.0.20,3260,1 iqn.2005-10.org.freenas.ctl:f10]
172.20.0.20:3260,1 iqn.2005-10.org.freenas.ctl:f11
172.20.0.20:3260,1 iqn.2005-10.org.freenas.ctl:f10

 

[HDmac]

Mine also happened during a power loss. I have not discovered how to fix the problem and have not been able to use iscsi as a target storage because of this. If you do figure it out, please post about it!

 

[colourreich]

Installed Proxmox on another computer to see what was different. There were default files on /etc/iscsi that were empty on the broken installation.

/etc/iscsi/nodes/iqn.*/default

After deleting them, iscsiadm --login worked and recreated those default files automatically.