I installed Proxmox 4.4 on a SuperMicro server and successfully migrated 2 VMs (Linux 64-bit and FreeBSD 32-bit) from ESXi 6. That went relatively smooth.
I'm now trying to install a storage VM to implement iSCSI shared storage for additional Proxmox nodes. The first node has a Dell H310 flashed to P20 firmware for LSI 9211-8i and 6 SATA drives. That setup worked well in ESXi 6 with OmniOS/napp-it or FreeNAS VMs using PCI Passthrough. I followed the PCI Passthrough notes on the Proxmox wiki, but was not successful getting the adapter to initialize disks properly with OmiOS or FreeNAS. I did blacklist the mpt2sas driver in /etc/modprobe.d, updated initramfs, rebooted and confirmed the module is not listed in lsmod to prevent Proxmox from accessing the disks. The LSI adapter is listed in lspci:
and I inserted the following on the VM config file:
The LSI adapter is detected by FreeNAS but the following error comes up periodically when initializing disks or volumes:
In OmniOS it is also detected but the following error comes up periodically when initializing disks:
A web search indicates that code 2622 implies "Request Equalization bit set during PCIe Training" which seems related to interrupts. 'dmesg | grep ecap' reports f020fe so interrupt remapping should be supported. In any case, tried allowing unsafe interrupts but removed it because it had no effect.
Any suggestions as to why PCI Passthrough is not working properly with this card (apparently due to interrupts) would be appreciated. I did try these alternate configurations without success. The PCI Express option made the problem worse, with the boot either not completing or reporting other errors.
I also checked these forum threads on similar problems, but they were not conclusive.
PCI passthrough LSI 9300-8i to OmniOS
Passthrough LSI HBA 2008
Proxmox VE 4.2 pci passthrough LSI 3008 (mpt3sas)
PVE versions are as follows:
Thanks.
I'm now trying to install a storage VM to implement iSCSI shared storage for additional Proxmox nodes. The first node has a Dell H310 flashed to P20 firmware for LSI 9211-8i and 6 SATA drives. That setup worked well in ESXi 6 with OmniOS/napp-it or FreeNAS VMs using PCI Passthrough. I followed the PCI Passthrough notes on the Proxmox wiki, but was not successful getting the adapter to initialize disks properly with OmiOS or FreeNAS. I did blacklist the mpt2sas driver in /etc/modprobe.d, updated initramfs, rebooted and confirmed the module is not listed in lsmod to prevent Proxmox from accessing the disks. The LSI adapter is listed in lspci:
Code:
root@pve0:/# lspci|grep LSI
06:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
Code:
hostpci0: 06:00
Code:
mps0: Warning: io_cmds_active is out of sync - resyncing to 0
Code:
MPT Firmware Fault, code 2622Any suggestions as to why PCI Passthrough is not working properly with this card (apparently due to interrupts) would be appreciated. I did try these alternate configurations without success. The PCI Express option made the problem worse, with the boot either not completing or reporting other errors.
Code:
machine: q35
hostpci0: 06:00.0,pcie=1
Code:
hostpci0: 06:00.0PCI passthrough LSI 9300-8i to OmniOS
Passthrough LSI HBA 2008
Proxmox VE 4.2 pci passthrough LSI 3008 (mpt3sas)
PVE versions are as follows:
Code:
root@pve0:~# pveversion -v
proxmox-ve: 4.4-76 (running kernel: 4.4.35-1-pve)
pve-manager: 4.4-1 (running version: 4.4-1/eb2d6f1e)
pve-kernel-4.4.35-1-pve: 4.4.35-76
lvm2: 2.02.116-pve3
corosync-pve: 2.4.0-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-101
pve-firmware: 1.1-10
libpve-common-perl: 4.0-83
libpve-access-control: 4.0-19
libpve-storage-perl: 4.0-70
pve-libspice-server1: 0.12.8-1
vncterm: 1.2-1
pve-docs: 4.4-1
pve-qemu-kvm: 2.7.0-9
pve-container: 1.0-88
pve-firewall: 2.0-33
pve-ha-manager: 1.0-38
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.6-2
lxcfs: 2.0.5-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.8-pve13~bpo80
openvswitch-switch: 2.3.0+git20140819-3+deb8u1
Last edited: