Proxmox with BCM57766 (tg3 driver)

[cuva]

Hi everybody,

I've been using Proxmox for quite some time now, and I love this OS.
However I currently have a network issue with the Broadcom BCM57766 chip.

I Installed the tg3 driver with dkms, but nothing works. I guess it comes from the
kernel version. Before putting proxmox on that machine, it used to be kernel 3.x and everything
worked fine after installing the tg3 module.

Does anyone has any idea on why this is not working ?
Thanks a lot,
Cuva

 

[MGB]

Hi Cuva,

I followed tg3 dkms instructions from the following: http://www.frozenindustries.com/2012/11/04/ubuntu-12-04-lts-on-an-apple-mac-mini-late-2012/ I installed wheezy and then added Proxmox 3.0 RC2 following the wiki instructions (also installed pve headers). Then tg3 Module loaded fine (see eth1 output from ifconfig below) but I still have major problem. Seems VLAN is broke with tg3. If I use no VLAN my guest work fine. If I set a VLAN and use a tagged port then the guest never appears on that VLAN network - (behaves as if no VLAN was set for the guest.) I suspect it just not putting the tag on. I can use virtio, or any of the emulated nics in the guest the result is the same. After much googling I found some indication other distributions found a VLAN problem with kernel 2.6.32 and tg3 but if there is a solution I have not found it yet.

Ethernet controller: Broadcom Corporation NetXtreme BCM57766 Gigabit Ethernet PCIe (rev 01)

eth0 Link encap:Ethernet HWaddr 00:50:b6:50:1e:33
inet6 addr: fe80::250:b6ff:fe50:1e33/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:34646 errors:0 dropped:0 overruns:0 frame:0
TX packets:24801 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:10050450 (9.5 MiB) TX bytes:17170556 (16.3 MiB)

eth1 Link encap:Ethernet HWaddr a8:20:66:1d:db:64
inet6 addr: fe80::aa20:66ff:fe1d:db64/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:4157 errors:0 dropped:0 overruns:0 frame:0
TX packets:370 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:444501 (434.0 KiB) TX bytes:51454 (50.2 KiB)
Interrupt:10

eth1.5 Link encap:Ethernet HWaddr a8:20:66:1d:db:64
inet6 addr: fe80::aa20:66ff:fe1d:db64/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:281 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:41886 (40.9 KiB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:18973 errors:0 dropped:0 overruns:0 frame:0
TX packets:18973 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:13425120 (12.8 MiB) TX bytes:13425120 (12.8 MiB)

tap100i0 Link encap:Ethernet HWaddr 62:75:9a:a4:62:16
inet6 addr: fe80::6075:9aff:fea4:6216/64 Scope:Link
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
RX packets:195 errors:0 dropped:0 overruns:0 frame:0
TX packets:90 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:36138 (35.2 KiB) TX bytes:6036 (5.8 KiB)

venet0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
inet6 addr: fe80::1/128 Scope:Link
UP BROADCAST POINTOPOINT RUNNING NOARP MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:3 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

vmbr0 Link encap:Ethernet HWaddr 00:50:b6:50:1e:33
inet addr:192.168.200.35 Bcast:192.168.200.255 Mask:255.255.255.0
inet6 addr: fe80::250:b6ff:fe50:1e33/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:34523 errors:0 dropped:0 overruns:0 frame:0
TX packets:24713 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:10040498 (9.5 MiB) TX bytes:17065578 (16.2 MiB)

vmbr1 Link encap:Ethernet HWaddr a8:20:66:1d:db:64
inet6 addr: fe80::aa20:66ff:fe1d:db64/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3874 errors:0 dropped:0 overruns:0 frame:0
TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:341975 (333.9 KiB) TX bytes:578 (578.0 B)

vmbr1v5 Link encap:Ethernet HWaddr a8:20:66:1d:db:64
inet6 addr: fe80::a882:2eff:fe0f:6be1/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:195 errors:0 dropped:0 overruns:0 frame:0
TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:33408 (32.6 KiB) TX bytes:468 (468.0 B)

 

[MGB]

Hi Cuva

Try http://www.frozenindustries.com/2012/11/04/ubuntu-12-04-lts-on-an-apple-mac-mini-late-2012/ It worked for me. I installed wheezy first, then Proxmox 3.0 RC2 then dkms and tg3.

However, problem is seems VLAN is broke on tg3 and 2.6.32, - I can not get any of my guests to use the tg3 bridge and VLAN even though it "seems" fine - ie ifconfig shows bridges and tap interfaces correctly. Guest runs fine but never gets onto the VLAN. I have a second server set up in similar way but not using broadcom nics and all guest work fine on VLANS.

MGB

 

[cuva]

Hi Cuva

Try http://www.frozenindustries.com/2012/11/04/ubuntu-12-04-lts-on-an-apple-mac-mini-late-2012/ It worked for me. I installed wheezy first, then Proxmox 3.0 RC2 then dkms and tg3.

However, problem is seems VLAN is broke on tg3 and 2.6.32, - I can not get any of my guests to use the tg3 bridge and VLAN even though it "seems" fine - ie ifconfig shows bridges and tap interfaces correctly. Guest runs fine but never gets onto the VLAN. I have a second server set up in similar way but not using broadcom nics and all guest work fine on VLANS.

MGB

Hey,

Yeah that's what i figured and I got it working. Though I still need to do the whole process again each time there is a kernel update.

I'm not using using VLANs on that network, so I can't really help you with your problem.
Good luck !

Cheers

 

[lotosbin]

ref: https://bugzilla.kernel.org/show_bug.cgi?id=12877#c64
GRUB_CMDLINE_LINUX="$GRUB_CMDLINE_LINUX amd_iommu=off intel_iommu=on iommu=pt"
works for me