iSCSI not allowing new virtual hard drives

[Charlie B]

post upgrade issues
since upgrading I have run into an issue with iSCSI. I am no longer able to clone my template machine onto any of my iSCSI devices. all of the virtual machines that are on the iSCSI devices work just fine. the issue seems to only exist when creating new hard drives.
Virtual Environment 5.4-6
proxmox-ve: 5.4-1 (running kernel: 4.15.18-15-pve)
pve-manager: 5.4-6 (running version: 5.4-6/aa7856c5)
pve-kernel-4.15: 5.4-3
pve-kernel-4.13: 5.2-2
pve-kernel-4.15.18-15-pve: 4.15.18-40
pve-kernel-4.15.18-12-pve: 4.15.18-36
pve-kernel-4.15.18-7-pve: 4.15.18-27
pve-kernel-4.15.18-1-pve: 4.15.18-19
pve-kernel-4.15.17-2-pve: 4.15.17-10
pve-kernel-4.15.15-1-pve: 4.15.15-6
pve-kernel-4.13.16-4-pve: 4.13.16-51
pve-kernel-4.13.16-3-pve: 4.13.16-50
pve-kernel-4.13.16-2-pve: 4.13.16-48
pve-kernel-4.13.16-1-pve: 4.13.16-46
pve-kernel-4.13.13-6-pve: 4.13.13-42
pve-kernel-4.13.13-2-pve: 4.13.13-33
ceph: 12.2.12-pve1
corosync: 2.4.4-pve1
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: 1.2-2
libjs-extjs: 6.0.1-2
libpve-access-control: 5.1-10
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-52
libpve-guest-common-perl: 2.0-20
libpve-http-server-perl: 2.0-13
libpve-storage-perl: 5.0-43
libqb0: 1.0.3-1~bpo9
lvm2: 2.02.168-pve6
lxc-pve: 3.1.0-3
lxcfs: 3.0.3-pve1
novnc-pve: 1.0.0-3
proxmox-widget-toolkit: 1.0-28
pve-cluster: 5.0-37
pve-container: 2.0-39
pve-docs: 5.4-2
pve-edk2-firmware: 1.20190312-1
pve-firewall: 3.0-22
pve-firmware: 2.0-6
pve-ha-manager: 2.0-9
pve-i18n: 1.1-4
pve-libspice-server1: 0.14.1-2
pve-qemu-kvm: 3.0.1-2
pve-xtermjs: 3.12.0-1
qemu-server: 5.0-52
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3
zfsutils-linux: 0.7.13-pve1~bpo2

 

[sb-jw]

If you gave us some information e.g. Logs, error messages etc. It might be possible to help you

Tell us a little more about your setup and Configs.

 

[Charlie B]

so I have 12 different Nas devices set up in the environment with iSCSI set up in multipath round-robin to connect back to all of my host machines.
there are two network ports in the host machine that connect to the iSCSI network and each Nas device has two network connections connecting as well.
when I look in the webpage I can see the contents and the summary for the devices.
I would be happy to attach log files. just let me know which ones you want.
when I go to create the drive or to migrate a drive from one device to another the system just hangs and then goes to the gray? State. if I click on stop to cancel the process after about 10 minutes I'm guessing it's a timeout, the system comes back and multicast starts communicating again.

I should mention that I have tried reinstalling both open-iSCSI and multipath-tools

 

[Charlie B]

so is a test on one of my host machines I rolled it back to the 5.3-2 iso. then I installed open-iSCSI and multipath-tools on the host. everything was working at this point. I upgraded to current and it broke again.
so for now I have rolled it back to the iso on this one host so that I can do machine deployments. the other hosts are still broken however I can migrate the machine to this functioning host, make my adjustments, and then migrate them back to where they were and they still function correctly. even after rebooting the host