iSCSI connection failed

cjkeist

New Member
Feb 11, 2020
14
0
1
51
Hello,
Running six node Proxmox cluster version 6.1-7 and run into a strange issue when removing an iSCSI volume from the cluster. Adding the iSCSI volume to the cluster goes through fine and there are no errors and system logs are clean. But then I decided to remove the iSCSI storage volume from the cluster. Doing that through the web GUI seemed to go through fine with no errors and no VM's were using the iSCSI share. I then removed the iSCSI target from the NAS storage unit. At that point, all the nodes in my cluster started spewing the following errors in the system logs:

ar 10 16:06:07 sun2 iscsid[1451]: connect to 192.168.50.10:3260 failed (Connection refused)
Mar 10 16:06:07 sun2 iscsid[1451]: connect to 10.206.20.207:3260 failed (Connection refused)
Mar 10 16:06:10 sun2 iscsid[1451]: connect to 192.168.50.10:3260 failed (Connection refused)
Mar 10 16:06:10 sun2 iscsid[1451]: connect to 10.206.20.207:3260 failed (Connection refused)

Why is the cluster still trying to connect to the iSCSI server when I removed it? It was the only iSCSI volume defined. The only way I can get the errors to stop is by rebooting the nodes. Looking for a solution that doesn't require rebooting the nodes.

Thanks...
 

dietmar

Proxmox Staff Member
Staff member
Apr 28, 2005
16,747
390
103
Austria
www.proxmox.com
Why is the cluster still trying to connect to the iSCSI server when I removed it?

for safety reasons, we do not cancel active storage connections ...

It was the only iSCSI volume defined. The only way I can get the errors to stop is by rebooting the nodes. Looking for a solution that doesn't require rebooting the nodes.

You can use iscsiadm to cancel active iscsi sessions (see "man iscsiadm")
 

cjkeist

New Member
Feb 11, 2020
14
0
1
51
Thanks for the reply. I tried the following with no success:

root@sun1:~# iscsiadm -m session -o show
tcp: [1] 192.168.50.10:3260,1 iqn.2010-09.org.zfs-app:1583855287 (non-flash)
tcp: [2] 10.206.20.207:3260,1 iqn.2010-09.org.zfs-app:1583855287 (non-flash)

root@sun1:~# iscsiadm -m node -T iqn.2010-09.org.zfs-app:1583855287 -p 192.168.50.10:3260 -u
Logging out of session [sid: 1, target: iqn.2010-09.org.zfs-app:1583855287, portal: 192.168.50.10,3260]
iscsiadm: Could not logout of [sid: 1, target: iqn.2010-09.org.zfs-app:1583855287, portal: 192.168.50.10,3260].
iscsiadm: initiator reported error (9 - internal error)
iscsiadm: Could not logout of all requested sessions

root@sun1:~# iscsiadm -m node -o delete -T iqn.2010-09.org.zfs-app:1583855287
iscsiadm: No records found

root@sun1:~# iscsiadm -m session -o show
tcp: [1] 192.168.50.10:3260,1 iqn.2010-09.org.zfs-app:1583855287 (non-flash)
tcp: [2] 10.206.20.207:3260,1 iqn.2010-09.org.zfs-app:1583855287 (non-flash)

The sessions will not go away. Both IP's are the iSCSI server seen on the two NICs on different VLANs. Could that be causing this issue?
 

cjkeist

New Member
Feb 11, 2020
14
0
1
51
Just update here. Never could find a way to stop the syslog messages other than rebooting the node.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!