Hi all,
I'm trying to use Proxmox with sr-iov on an intel I350 and it seems each time I starts sr-iov via igbvf, it's reset the status before I can do anything else.
Looking at the logs I see the creation of the group in iommu and being reseated just after.
Any idea what to look?
Feb 2 14:39:53 proxmox kernel: [ 1.588908] igbvf: Intel(R) Gigabit Virtual Function Network Driver - version 2.4.0-k
Feb 2 14:39:53 proxmox kernel: [ 1.588909] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
Feb 2 14:39:53 proxmox kernel: [ 1.588922] igbvf 0000:04:11.5: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.590126] igbvf 0000:04:11.5: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.590127] igbvf 0000:04:11.5: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.591438] igbvf 0000:04:11.5: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.591439] igbvf 0000:04:11.5: Address: 06:9a:e0:e9:eb:9b
Feb 2 14:39:53 proxmox kernel: [ 1.591661] igbvf 0000:04:12.1: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.592866] igbvf 0000:04:12.1: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.592867] igbvf 0000:04:12.1: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.594160] igbvf 0000:04:12.1: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.594161] igbvf 0000:04:12.1: Address: 8a:d9:cd:37:eb:6f
Feb 2 14:39:53 proxmox kernel: [ 1.594380] igbvf 0000:04:12.5: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.595575] igbvf 0000:04:12.5: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.595576] igbvf 0000:04:12.5: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.596880] igbvf 0000:04:12.5: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.596881] igbvf 0000:04:12.5: Address: 96:76:42:06:92:6d
Feb 2 14:39:53 proxmox kernel: [ 1.597092] igbvf 0000:04:13.1: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.598285] igbvf 0000:04:13.1: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.598286] igbvf 0000:04:13.1: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.599570] igbvf 0000:04:13.1: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.599571] igbvf 0000:04:13.1: Address: ea:52:3b:43:23:0d
Dmesg output
[ 1.588249] iommu: Adding device 0000:04:10.1 to group 35
[ 1.588465] iommu: Adding device 0000:04:10.5 to group 36
[ 1.588658] iommu: Adding device 0000:04:11.1 to group 37
[ 1.588894] iommu: Adding device 0000:04:11.5 to group 38
[ 1.591634] iommu: Adding device 0000:04:12.1 to group 39
[ 1.594351] iommu: Adding device 0000:04:12.5 to group 40
[ 1.597064] iommu: Adding device 0000:04:13.1 to group 41
[ 1.599740] iommu: Removing device 0000:04:10.1 from group 35
[ 1.599784] iommu: Removing device 0000:04:10.5 from group 36
[ 1.599825] iommu: Removing device 0000:04:11.1 from group 37
[ 1.644070] iommu: Removing device 0000:04:11.5 from group 38
[ 1.688076] iommu: Removing device 0000:04:12.1 from group 39
[ 1.736106] iommu: Removing device 0000:04:12.5 from group 40
[ 1.788015] iommu: Removing device 0000:04:13.1 from group 41
I'm trying to use Proxmox with sr-iov on an intel I350 and it seems each time I starts sr-iov via igbvf, it's reset the status before I can do anything else.
Looking at the logs I see the creation of the group in iommu and being reseated just after.
Any idea what to look?
Feb 2 14:39:53 proxmox kernel: [ 1.588908] igbvf: Intel(R) Gigabit Virtual Function Network Driver - version 2.4.0-k
Feb 2 14:39:53 proxmox kernel: [ 1.588909] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
Feb 2 14:39:53 proxmox kernel: [ 1.588922] igbvf 0000:04:11.5: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.590126] igbvf 0000:04:11.5: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.590127] igbvf 0000:04:11.5: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.591438] igbvf 0000:04:11.5: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.591439] igbvf 0000:04:11.5: Address: 06:9a:e0:e9:eb:9b
Feb 2 14:39:53 proxmox kernel: [ 1.591661] igbvf 0000:04:12.1: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.592866] igbvf 0000:04:12.1: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.592867] igbvf 0000:04:12.1: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.594160] igbvf 0000:04:12.1: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.594161] igbvf 0000:04:12.1: Address: 8a:d9:cd:37:eb:6f
Feb 2 14:39:53 proxmox kernel: [ 1.594380] igbvf 0000:04:12.5: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.595575] igbvf 0000:04:12.5: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.595576] igbvf 0000:04:12.5: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.596880] igbvf 0000:04:12.5: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.596881] igbvf 0000:04:12.5: Address: 96:76:42:06:92:6d
Feb 2 14:39:53 proxmox kernel: [ 1.597092] igbvf 0000:04:13.1: enabling device (0000 -> 0002)
Feb 2 14:39:53 proxmox kernel: [ 1.598285] igbvf 0000:04:13.1: PF still in reset state. Is the PF interface up?
Feb 2 14:39:53 proxmox kernel: [ 1.598286] igbvf 0000:04:13.1: Assigning random MAC address.
Feb 2 14:39:53 proxmox kernel: [ 1.599570] igbvf 0000:04:13.1: Intel(R) I350 Virtual Function
Feb 2 14:39:53 proxmox kernel: [ 1.599571] igbvf 0000:04:13.1: Address: ea:52:3b:43:23:0d
Dmesg output
[ 1.588249] iommu: Adding device 0000:04:10.1 to group 35
[ 1.588465] iommu: Adding device 0000:04:10.5 to group 36
[ 1.588658] iommu: Adding device 0000:04:11.1 to group 37
[ 1.588894] iommu: Adding device 0000:04:11.5 to group 38
[ 1.591634] iommu: Adding device 0000:04:12.1 to group 39
[ 1.594351] iommu: Adding device 0000:04:12.5 to group 40
[ 1.597064] iommu: Adding device 0000:04:13.1 to group 41
[ 1.599740] iommu: Removing device 0000:04:10.1 from group 35
[ 1.599784] iommu: Removing device 0000:04:10.5 from group 36
[ 1.599825] iommu: Removing device 0000:04:11.1 from group 37
[ 1.644070] iommu: Removing device 0000:04:11.5 from group 38
[ 1.688076] iommu: Removing device 0000:04:12.1 from group 39
[ 1.736106] iommu: Removing device 0000:04:12.5 from group 40
[ 1.788015] iommu: Removing device 0000:04:13.1 from group 41