Search results

I was never able to get 1st gen ConnectX cards to work in native 10gigE mode. Even with these later firmware (provided by Whatever). I suspect mlx4_en is broken or dropped support for 1st gen cards now that they are EOL-ed. alexskysilk, Please note, when you run cards in Infiniband mode (e.g...

Can you elaborate with more details. Like craft a bootable image with grub-entries for loading different kickstart files available? Wouldn't having a boot image still require rebuilds of said image whenever any included kickstart files change? And wouldn't boot image have to be different for...

Shouldn't it be this instead? vcpus:2 = numa0:socket0:core0, numa0:socket0:core2 This way vCPUs are scheduled within the same NUMA group (i.e. same physical CPU in this case), thus benefiting from local-to CPU cache and avoid socket-to-socket communication.

I have no control over network/dhcp. So that's exactly what I've been doing. Making install DVD images with custom kickstart files. I now have about 15-17 different ones (server vs client, 6.x vs 7.1, etc). Images take too much space (15+ at 4 GBytes each). Take relatively too long to change...

So is it like PXE? Problem is when you are on a larger network and do not control the DHCP service.

Re: Unable to see Infiniband interfaces on Proxmox? Yes, I'd be very much interested in obtaining these later firmwares. Will send you a PM just in case. Edit: turns out there is no PM enabled here.

Re: Unable to see Infiniband interfaces on Proxmox? I initially plugged them into an ethernet switch (gigE switch with 4 10gigE uplink ports). To eliminate switch or the CX4->SFP+ cable as the cause of the problem, I took the two systems with same ConnectX-1 DDR cards and connected the two...

Re: Unable to see Infiniband interfaces on Proxmox? So I finally got the CX4 -> SFP+ cable. The cards is set to native 10gigE mode. Connected an ethernet switch 10gig uplink and... getting extremely slow speed. To troubleshoot I have quickly thrown together 2 Proxmox test systems ConnectX...

There is too much info and too little time to explain technical details in one post. You gonna have to do some reading. Google is your friend. Both Linux bridging/bonding and OVS are two technologies that achieve the same result (e.g. bonding, bridging, VLANs). Just two different...

Scenario: Two PVE servers have dual NICs each. One NIC (eth0) in each server is connected to the wider network. Machines are also directly connected to each other (via eth1) ports for glusterfs replication. Once enabled, pve-firewall filters all interfaces. What is the best way to...

With a linux bridge/bonding or similar via OVS. There is even a page for PVE: https://pve.proxmox.com/wiki/Open_vSwitch

Where do you see 200 and 400% CPU use? Your top screenshot says your machine is mostly idle.

Re: Unable to see Infiniband interfaces on Proxmox? Yes, it's just a passive cable with CX4 and SFP+ on opposite ends. Your VPI card has to be switched into native 10gig Ethernet mode. Not IPoIB. That means special changes need to be made to load the right modules. Read my posts in this...

Re: Unable to see Infiniband interfaces on Proxmox? I haven't got mine yet. Still in the mail. From my research, no active media converter is needed for this type of cable. I got mine from ebay, but I can't find any one. Once in a while they pop up. I don't know where you are, but here is...

Re: Unable to see Infiniband interfaces on Proxmox? For 10gigE vs SDR IB it's 10Gbit/s vs 8Gbit/s. At least in theory. I do not know what the actual performance difference is, but in my case IPoIB theoretical limit is higher at 16Git/sec as I have a DDR IB card. But I have no IB switch...

Re: Unable to see Infiniband interfaces on Proxmox? I did run that as I changed modprob.d. But it appears I've made too many changes in too many places. I had to re-trace my steps. I'm now confident this method for enabling native 10gigE mode works: #cat /etc/modules mlx4_en #cat...

Re: Unable to see Infiniband interfaces on Proxmox? Well, I guess I got it to work. (edit: not yet.)All it took was to add the module and its params to /etc/modules. Somehow missed the fact I could specify params there too (edit: nope, params still ignored). cat /etc/modules mlx4_core...

That would indicate no module was found/loaded for your card. Ummm... you did this immediately after installing the card? And installed all modules at once? It's possible something might be clobbering something else. It's tough to say if you managed to install the module properly. Most modules...

Just for "fun" I've tried setting few other of mlx4_core params in /etc/modprobe.d/mlx4.conf: probe_vf, num_vfs, hpn, debug_level. First 2 are undefined by default. Other two are both 0 by default. options mlx4_core port_type_array=2,2 num_vfs=8,0,0 probe_vf=8,0,0 hpn=1 debug_level=6 Tried...

Just tried adding quotes. Didn't work either. Also tried in /etc/modprobe.d/mlx4.conf install mlx4_core /sbin/modprobe mlx4_core port_type_array="2,2"