Search results

  1. Unable to see Infiniband interfaces in Proxmox?

    I was never able to get 1st gen ConnectX cards to work in native 10gigE mode. Even with these later firmware (provided by Whatever). I suspect mlx4_en is broken or dropped support for 1st gen cards now that they are EOL-ed. alexskysilk, Please note, when you run cards in Infiniband mode (e.g...
  2. Using kickstart files with the qm create command?

    Can you elaborate with more details. Like craft a bootable image with grub-entries for loading different kickstart files available? Wouldn't having a boot image still require rebuilds of said image whenever any included kickstart files change? And wouldn't boot image have to be different for...
  3. NUMA and CPU hotplugging - best practices

    Shouldn't it be this instead? vcpus:2 = numa0:socket0:core0, numa0:socket0:core2 This way vCPUs are scheduled within the same NUMA group (i.e. same physical CPU in this case), thus benefiting from local-to CPU cache and avoid socket-to-socket communication.
  4. Using kickstart files with the qm create command?

    I have no control over network/dhcp. So that's exactly what I've been doing. Making install DVD images with custom kickstart files. I now have about 15-17 different ones (server vs client, 6.x vs 7.1, etc). Images take too much space (15+ at 4 GBytes each). Take relatively too long to change...
  5. Using kickstart files with the qm create command?

    So is it like PXE? Problem is when you are on a larger network and do not control the DHCP service.
  6. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? Yes, I'd be very much interested in obtaining these later firmwares. Will send you a PM just in case. Edit: turns out there is no PM enabled here.
  7. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? I initially plugged them into an ethernet switch (gigE switch with 4 10gigE uplink ports). To eliminate switch or the CX4->SFP+ cable as the cause of the problem, I took the two systems with same ConnectX-1 DDR cards and connected the two...
  8. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? So I finally got the CX4 -> SFP+ cable. The cards is set to native 10gigE mode. Connected an ethernet switch 10gig uplink and... getting extremely slow speed. To troubleshoot I have quickly thrown together 2 Proxmox test systems ConnectX...
  9. Create redundancy of links

    There is too much info and too little time to explain technical details in one post. You gonna have to do some reading. Google is your friend. Both Linux bridging/bonding and OVS are two technologies that achieve the same result (e.g. bonding, bridging, VLANs). Just two different...
  10. pve-firewall: best practice to minimize firewall overhead for glusterfs?

    Scenario: Two PVE servers have dual NICs each. One NIC (eth0) in each server is connected to the wider network. Machines are also directly connected to each other (via eth1) ports for glusterfs replication. Once enabled, pve-firewall filters all interfaces. What is the best way to...
  11. Create redundancy of links

    With a linux bridge/bonding or similar via OVS. There is even a page for PVE: https://pve.proxmox.com/wiki/Open_vSwitch
  12. Why processor use high cpu on KVM?

    Where do you see 200 and 400% CPU use? Your top screenshot says your machine is mostly idle.
  13. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? Yes, it's just a passive cable with CX4 and SFP+ on opposite ends. Your VPI card has to be switched into native 10gig Ethernet mode. Not IPoIB. That means special changes need to be made to load the right modules. Read my posts in this...
  14. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? I haven't got mine yet. Still in the mail. From my research, no active media converter is needed for this type of cable. I got mine from ebay, but I can't find any one. Once in a while they pop up. I don't know where you are, but here is...
  15. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? For 10gigE vs SDR IB it's 10Gbit/s vs 8Gbit/s. At least in theory. I do not know what the actual performance difference is, but in my case IPoIB theoretical limit is higher at 16Git/sec as I have a DDR IB card. But I have no IB switch...
  16. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? I did run that as I changed modprob.d. But it appears I've made too many changes in too many places. I had to re-trace my steps. I'm now confident this method for enabling native 10gigE mode works: #cat /etc/modules mlx4_en #cat...
  17. Unable to see Infiniband interfaces in Proxmox?

    Re: Unable to see Infiniband interfaces on Proxmox? Well, I guess I got it to work. (edit: not yet.)All it took was to add the module and its params to /etc/modules. Somehow missed the fact I could specify params there too (edit: nope, params still ignored). cat /etc/modules mlx4_core...
  18. Quad Port Ethernet Adapter Installation Problem

    That would indicate no module was found/loaded for your card. Ummm... you did this immediately after installing the card? And installed all modules at once? It's possible something might be clobbering something else. It's tough to say if you managed to install the module properly. Most modules...
  19. Unable to see Infiniband interfaces in Proxmox?

    Just for "fun" I've tried setting few other of mlx4_core params in /etc/modprobe.d/mlx4.conf: probe_vf, num_vfs, hpn, debug_level. First 2 are undefined by default. Other two are both 0 by default. options mlx4_core port_type_array=2,2 num_vfs=8,0,0 probe_vf=8,0,0 hpn=1 debug_level=6 Tried...
  20. Unable to see Infiniband interfaces in Proxmox?

    Just tried adding quotes. Didn't work either. Also tried in /etc/modprobe.d/mlx4.conf install mlx4_core /sbin/modprobe mlx4_core port_type_array="2,2"

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!