Hi
In my setup we decided to change connection to remote storage from FibreChannel to RoCE. All the time, this is the same remote storage source (the same storage array) but used different underlaying storage technology. The array is made by Huawei. Since that change during higher network traffic on proxmoxes multipath shows failing path and start to reinstaling path. We try to change multipath to nvme.core.multipath but this change did not help anything. Previously when we used FC there weren't such problems. I attach multipath configuration below.
During higher network traffic or if I try to import qcow file to datastore:
Anybody have simillar problem with multipath and is able to help me to resolve this problem?
Best regards
Tom
In my setup we decided to change connection to remote storage from FibreChannel to RoCE. All the time, this is the same remote storage source (the same storage array) but used different underlaying storage technology. The array is made by Huawei. Since that change during higher network traffic on proxmoxes multipath shows failing path and start to reinstaling path. We try to change multipath to nvme.core.multipath but this change did not help anything. Previously when we used FC there weren't such problems. I attach multipath configuration below.
Code:
defaults {
polling_interval 1
user_friendly_names yes
#enable_foreign nvme
enable_foreign "^$"
#verbosity 4
}
blacklist_exceptions {
property "(ID_WWN|SCSI_IDENT_.*|ID_SERIAL|DEVTYPE)"
devnode "nvme*"
}
devices {
device {
vendor "NVME"
product "Huawei-XSG1"
uid_attribute "ID_WWN"
no_path_retry 12
rr_min_io 100
path_grouping_policy multibus
#path_grouping_policy group_by_prio
path_checker "directio"
#prio "const"
detect_prio "no"
prio "const"
failback immediate
retain_attached_hw_handler "no"
}
}
multipaths {
multipath {
wwid ******
alias RoCE_***
}
multipath {
wwid ******
alias RoCE_***
}
}During higher network traffic or if I try to import qcow file to datastore:
Code:
[Fri Feb 14 08:22:56 2025] device-mapper: multipath: 252:16: Failing path 259:16.
[Fri Feb 14 08:23:09 2025] device-mapper: multipath: 252:16: Reinstating path 259:16.
[Fri Feb 14 08:23:26 2025] device-mapper: multipath: 252:16: Failing path 259:18.
[Fri Feb 14 08:23:26 2025] device-mapper: multipath: 252:16: Failing path 259:26.
[Fri Feb 14 08:23:40 2025] device-mapper: multipath: 252:16: Reinstating path 259:18.
[Fri Feb 14 08:23:40 2025] device-mapper: multipath: 252:16: Reinstating path 259:26.
[Fri Feb 14 08:23:56 2025] device-mapper: multipath: 252:16: Failing path 259:22.
[Fri Feb 14 08:24:08 2025] device-mapper: multipath: 252:16: Reinstating path 259:22.
[Fri Feb 14 08:24:09 2025] device-mapper: multipath: 252:16: Failing path 259:20.
[Fri Feb 14 08:24:21 2025] device-mapper: multipath: 252:16: Reinstating path 259:20.
[Fri Feb 14 08:24:39 2025] device-mapper: multipath: 252:16: Failing path 259:30.Anybody have simillar problem with multipath and is able to help me to resolve this problem?
Best regards
Tom