[5.2] SR-IOV VF Adapter not auto start on boot.

Talion

Member
Jun 19, 2018
15
0
21
47
Hello,

I have got SR-IOV enabled system and i see VF devices. I assigned IP address to my VF adapter but it doesn't work with boot. When i manually activate it, it works!

How can i activate it on boot?

bXB8AfF.png


Code:
root@n1:~# ip l
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: ens2f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:7d:18:a8 brd ff:ff:ff:ff:ff:ff
    vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
    vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
    vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
    vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
3: enp3s16f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 82:70:1c:ab:e9:b4 brd ff:ff:ff:ff:ff:ff
4: enp3s16f3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether a6:86:12:cd:6f:64 brd ff:ff:ff:ff:ff:ff
5: enp3s16f5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 56:50:e5:da:5a:1f brd ff:ff:ff:ff:ff:ff
6: enp3s16f7: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 92:5e:dc:a5:0c:19 brd ff:ff:ff:ff:ff:ff
7: ens2f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:7d:18:a9 brd ff:ff:ff:ff:ff:ff
    vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
    vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
    vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
    vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off
8: enp3s16: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 92:70:61:8a:02:7e brd ff:ff:ff:ff:ff:ff
9: enp3s16f2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 4e:26:8f:36:22:b6 brd ff:ff:ff:ff:ff:ff
10: enp3s16f4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 22:b9:d7:83:3f:7a brd ff:ff:ff:ff:ff:ff
11: enp3s16f6: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether d6:51:01:1e:2f:cd brd ff:ff:ff:ff:ff:ff


Code:
root@n1:~# cat /etc/network/interfaces

auto lo
iface lo inet loopback

iface ens2f0 inet manual

iface eno1 inet manual

iface eno2 inet manual

iface eno3 inet manual

iface eno4 inet manual

auto enp3s16
iface enp3s16 inet static
        address  172.29.236.11
        netmask  255.255.255.0
#Cluster Network

iface enp3s16f1 inet manual

iface enp3s16f2 inet manual

iface enp3s16f3 inet manual

iface enp3s16f4 inet manual

iface enp3s16f5 inet manual

iface enp3s16f6 inet manual

iface enp3s16f7 inet manual

auto ens2f1
iface ens2f1 inet static
        address  172.29.244.11
        netmask  255.255.255.0
#Storage Network

auto vmbr0
iface vmbr0 inet static
        address  212.x.x.x
        netmask  255.255.255.0
        gateway  212.x.x.x
        bridge_ports ens2f0
        bridge_stp off
        bridge_fd 0

Code:
root@n1:~# dmesg | grep ixgbe
[    1.471483] ixgbe: loading out-of-tree module taints kernel.
[    1.500047] ixgbe: I/O Virtualization (IOV) set to 4
[    1.500049] ixgbe: 0000:03:00.0: ixgbe_check_options: FCoE Offload feature enabled
[    1.632325] ixgbe 0000:03:00.0: Enabling SR-IOV VFs using the max_vfs module parameter is deprecated.
[    1.632326] ixgbe 0000:03:00.0: Please use the pci sysfs interface instead. Ex:
[    1.632329] ixgbe 0000:03:00.0: echo '4' > /sys/bus/pci/devices/0000:03:00.0/sriov_numvfs
[    1.741243] ixgbe 0000:03:00.0: SR-IOV enabled with 4 VFs
[    1.741244] ixgbe 0000:03:00.0: configure port vlans to keep your VFs secure
[    1.741468] ixgbevf: Intel(R) 10 Gigabit PCI Express Virtual Function Network Driver - version 4.1.0-k
[    1.741469] ixgbevf: Copyright (c) 2009 - 2015 Intel Corporation.
[    1.767520] ixgbe 0000:03:00.0: PCI Express bandwidth of 32GT/s available
[    1.767522] ixgbe 0000:03:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    1.767605] ixgbe 0000:03:00.0 eth0: MAC: 2, PHY: 14, SFP+: 3, PBA No: E70856-010
[    1.767607] ixgbe 0000:03:00.0: 90:e2:ba:7d:18:a8
[    1.767612] ixgbe 0000:03:00.0 eth0: Enabled Features: RxQ: 4 TxQ: 4
[    1.767659] ixgbe 0000:03:00.0 eth0: Intel(R) 10 Gigabit Network Connection
[    1.788108] ixgbe: I/O Virtualization (IOV) set to 4
[    1.788110] ixgbe: 0000:03:00.1: ixgbe_check_options: FCoE Offload feature enabled
[    1.920516] ixgbe 0000:03:00.1: Enabling SR-IOV VFs using the max_vfs module parameter is deprecated.
[    1.920518] ixgbe 0000:03:00.1: Please use the pci sysfs interface instead. Ex:
[    1.920520] ixgbe 0000:03:00.1: echo '4' > /sys/bus/pci/devices/0000:03:00.1/sriov_numvfs
[    2.028339] ixgbevf 0000:03:10.1: enabling device (0000 -> 0002)
[    2.029471] ixgbevf 0000:03:10.1: PF still in reset state.  Is the PF interface up?
[    2.029472] ixgbevf 0000:03:10.1: Assigning random MAC address
[    2.760350] ixgbevf 0000:03:10.1: 82:70:1c:ab:e9:b4
[    2.760353] ixgbevf 0000:03:10.1: MAC: 1
[    2.760355] ixgbevf 0000:03:10.1: Intel(R) 82599 Virtual Function
[    2.760624] ixgbevf 0000:03:10.3: enabling device (0000 -> 0002)
[    2.761774] ixgbevf 0000:03:10.3: PF still in reset state.  Is the PF interface up?
[    2.761775] ixgbevf 0000:03:10.3: Assigning random MAC address
[    2.762015] ixgbevf 0000:03:10.3: a6:86:12:cd:6f:64
[    2.762020] ixgbevf 0000:03:10.3: MAC: 1
[    2.762022] ixgbevf 0000:03:10.3: Intel(R) 82599 Virtual Function
[    2.762278] ixgbevf 0000:03:10.5: enabling device (0000 -> 0002)
[    2.763426] ixgbevf 0000:03:10.5: PF still in reset state.  Is the PF interface up?
[    2.763427] ixgbevf 0000:03:10.5: Assigning random MAC address
[    2.763658] ixgbevf 0000:03:10.5: 56:50:e5:da:5a:1f
[    2.763660] ixgbevf 0000:03:10.5: MAC: 1
[    2.763662] ixgbevf 0000:03:10.5: Intel(R) 82599 Virtual Function
[    2.763926] ixgbevf 0000:03:10.7: enabling device (0000 -> 0002)
[    2.765086] ixgbevf 0000:03:10.7: PF still in reset state.  Is the PF interface up?
[    2.765087] ixgbevf 0000:03:10.7: Assigning random MAC address
[    2.765322] ixgbevf 0000:03:10.7: 92:5e:dc:a5:0c:19
[    2.765324] ixgbevf 0000:03:10.7: MAC: 1
[    2.765326] ixgbevf 0000:03:10.7: Intel(R) 82599 Virtual Function
[    2.765349] ixgbe 0000:03:00.1: SR-IOV enabled with 4 VFs
[    2.765351] ixgbe 0000:03:00.1: configure port vlans to keep your VFs secure
[    2.791641] ixgbe 0000:03:00.1: PCI Express bandwidth of 32GT/s available
[    2.791643] ixgbe 0000:03:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    2.791728] ixgbe 0000:03:00.1 eth5: MAC: 2, PHY: 14, SFP+: 4, PBA No: E70856-010
[    2.791731] ixgbe 0000:03:00.1: 90:e2:ba:7d:18:a9
[    2.791734] ixgbe 0000:03:00.1 eth5: Enabled Features: RxQ: 4 TxQ: 4
[    2.791787] ixgbe 0000:03:00.1 eth5: Intel(R) 10 Gigabit Network Connection
[    2.791860] ixgbevf 0000:03:10.0: enabling device (0000 -> 0002)
[    2.793029] ixgbevf 0000:03:10.0: PF still in reset state.  Is the PF interface up?
[    2.793031] ixgbevf 0000:03:10.0: Assigning random MAC address
[    2.793098] ixgbe 0000:03:00.1 ens2f1: renamed from eth5
[    2.824234] ixgbe 0000:03:00.0 ens2f0: renamed from eth0
[    2.868522] ixgbevf 0000:03:10.0: 92:70:61:8a:02:7e
[    2.868525] ixgbevf 0000:03:10.0: MAC: 1
[    2.868527] ixgbevf 0000:03:10.0: Intel(R) 82599 Virtual Function
[    2.868609] ixgbevf 0000:03:10.2: enabling device (0000 -> 0002)
[    2.869758] ixgbevf 0000:03:10.2: PF still in reset state.  Is the PF interface up?
[    2.869760] ixgbevf 0000:03:10.2: Assigning random MAC address
[    2.870057] ixgbevf 0000:03:10.2: 4e:26:8f:36:22:b6
[    2.870059] ixgbevf 0000:03:10.2: MAC: 1
[    2.870061] ixgbevf 0000:03:10.2: Intel(R) 82599 Virtual Function
[    2.870139] ixgbevf 0000:03:10.4: enabling device (0000 -> 0002)
[    2.871298] ixgbevf 0000:03:10.4: PF still in reset state.  Is the PF interface up?
[    2.871300] ixgbevf 0000:03:10.4: Assigning random MAC address
[    2.871571] ixgbevf 0000:03:10.4: 22:b9:d7:83:3f:7a
[    2.871573] ixgbevf 0000:03:10.4: MAC: 1
[    2.871575] ixgbevf 0000:03:10.4: Intel(R) 82599 Virtual Function
[    2.871646] ixgbevf 0000:03:10.6: enabling device (0000 -> 0002)
[    2.872796] ixgbevf 0000:03:10.6: PF still in reset state.  Is the PF interface up?
[    2.872798] ixgbevf 0000:03:10.6: Assigning random MAC address
[    2.873024] ixgbevf 0000:03:10.6: d6:51:01:1e:2f:cd
[    2.873026] ixgbevf 0000:03:10.6: MAC: 1
[    2.873029] ixgbevf 0000:03:10.6: Intel(R) 82599 Virtual Function
[    2.876014] ixgbevf 0000:03:10.0 enp3s16: renamed from eth0
[    2.944323] ixgbevf 0000:03:10.7 enp3s16f7: renamed from eth4
[    2.964357] ixgbevf 0000:03:10.6 enp3s16f6: renamed from eth7
[    2.984680] ixgbevf 0000:03:10.2 enp3s16f2: renamed from eth5
[    3.016339] ixgbevf 0000:03:10.4 enp3s16f4: renamed from eth6
[    3.056338] ixgbevf 0000:03:10.3 enp3s16f3: renamed from eth2
[    3.136256] ixgbevf 0000:03:10.5 enp3s16f5: renamed from eth3
[    3.172346] ixgbevf 0000:03:10.1 enp3s16f1: renamed from eth1
[   11.667914] ixgbevf: Unable to start - perhaps the PF Driver isn't up yet
[   11.694657] ixgbe 0000:03:00.1: registered PHC device on ens2f1
[   11.859382] ixgbe 0000:03:00.0: registered PHC device on ens2f0
[   11.872130] ixgbe 0000:03:00.1 ens2f1: detected SFP+: 4
[   12.032214] ixgbe 0000:03:00.0 ens2f0: detected SFP+: 3
[   12.032465] ixgbe 0000:03:00.1 ens2f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[   12.288155] ixgbe 0000:03:00.0 ens2f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

Thanks

Talion
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!