Hah, I never found that. Knowing (from you) that this exists, I now found it (but I had to look several times, because . Thanks!
I'm lazy, what can I say.
No, so I guess - with my newly acquired knowledge - I can now not only remove the PVE...
Hi,
I have PVE running side-by-side to my PBS, mostly for the parts of the GUI that is not implemented in PBS, like updates.
And I have notifications enabled both in PVE and PBS. So now I'm getting notifications twice.
Is it safe to disable...
Hi,
I am experiencing issues with one of my VMs currently. For a reason not yet understood, it goes into 100% cpu load and the guest agent is shown as not active.
Is it possible to have PVE notify me, if something like this (e.g. high/full CPU_...
Thank you!
modprobe: FATAL: Module rdma not found in directory /lib/modules/6.8.12-8-pve
My cards are set to ethernet mode right now. Would that explain this error message (because in ethernet mode rdma might not work)?
# ibstat
CA 'rocep101s0'
CA type: MT4099
Number of ports: 2
Firmware version: 2.36.5000
Hardware version: 1
Node GUID: 0x248a07030078bb90
System image GUID: 0x248a07030078bb93
Port 1...
So I got that Ethernet license as well and switched two of my three cards to Ethernet mode (and, of course, also the switch). With iperf I got a throughput of (close to) 30gbps. Not bad! Or so I thought. I switched also the last card to Ethernet...
I haven't given up yet.
And I did find out something: So the default (group) rate for an IB subnet (at least as provided on my SX6036) seems to be 10gbps (that's what the ipdiagnet output suggests but I also found some link to corroborate where...
I have two potential explanations for the low throughout of my 40/56gbps IPoIB:
- There might be a bottleneck in the PCIe slots that my IB cards sit in (I have relatively small servers with only few PCI lanes and the available slots may have too...
Yeah, well, I already have the expensive switch, so... And while the IB switch has way more ports than my 10gbe switch, I actually do need fewer of them because my IB cards only have two ports whereas my 10gbe cards have four.
And the whole...
Okay, so I got all three nodes to talk to each other over the new infiniband network. And my switch reports that all nodes are connected via 56gbps links (although I didn't purchase the more expensive cables :D) So that's a win.
But the...
Ah, found this: https://pve.proxmox.com/wiki/Infiniband
And got the VPI card show up as an ethernet interface (while it is still being recognized by the switch). Getting closer...
Took me a while to get the new cards and then a couple of other things diverted my focus.
But I have been gradually replacing my nodes and each new node got one of the new cards and now all nodes are equipped with true infiniband cards. One card...