Recent content by proxwolfe

  1. P

    Double notifications from PBS and PVE

    Hah, I never found that. Knowing (from you) that this exists, I now found it (but I had to look several times, because . Thanks! I'm lazy, what can I say. No, so I guess - with my newly acquired knowledge - I can now not only remove the PVE notifications but the entire PVE. Cool! Thanks.
  2. P

    Double notifications from PBS and PVE

    No, PVE doesn't do anything. I only have it there for the GUI features. This is just my PBS with an additional GUI.
  3. P

    Double notifications from PBS and PVE

    Hi, I have PVE running side-by-side to my PBS, mostly for the parts of the GUI that is not implemented in PBS, like updates. And I have notifications enabled both in PVE and PBS. So now I'm getting notifications twice. Is it safe to disable notifications in either PVE or PBS? I wouldn't want...
  4. P

    Notifications for high cpu load or oom possible?

    Hi, I am experiencing issues with one of my VMs currently. For a reason not yet understood, it goes into 100% cpu load and the guest agent is shown as not active. Is it possible to have PVE notify me, if something like this (e.g. high/full CPU_ load, guest agent down, oom, ...) happens in a...
  5. P

    [SOLVED] Slow 40GBit Infiniband on Proxmox 8.1.4

    Thank you! modprobe: FATAL: Module rdma not found in directory /lib/modules/6.8.12-8-pve My cards are set to ethernet mode right now. Would that explain this error message (because in ethernet mode rdma might not work)?
  6. P

    Looking for a "cheap" way to upgrade to 40gibt

    # ibstat CA 'rocep101s0' CA type: MT4099 Number of ports: 2 Firmware version: 2.36.5000 Hardware version: 1 Node GUID: 0x248a07030078bb90 System image GUID: 0x248a07030078bb93 Port 1: State: Active Physical...
  7. P

    Looking for a "cheap" way to upgrade to 40gibt

    Thanks for the hint! I don't think my cards are limited in that way because I have them in eth mode and do reach throughput of 15 to 20 gbps that way.
  8. P

    [SOLVED] Slow 40GBit Infiniband on Proxmox 8.1.4

    So I got that Ethernet license as well and switched two of my three cards to Ethernet mode (and, of course, also the switch). With iperf I got a throughput of (close to) 30gbps. Not bad! Or so I thought. I switched also the last card to Ethernet mode and ... have never been able to reproduce the...
  9. P

    [SOLVED] Slow 40GBit Infiniband on Proxmox 8.1.4

    I haven't given up yet. And I did find out something: So the default (group) rate for an IB subnet (at least as provided on my SX6036) seems to be 10gbps (that's what the ipdiagnet output suggests but I also found some link to corroborate where it said that the default setting of "3" for the...
  10. P

    [SOLVED] Slow 40GBit Infiniband on Proxmox 8.1.4

    Great find! I'm going to try that as well.
  11. P

    Looking for a "cheap" way to upgrade to 40gibt

    I have two potential explanations for the low throughout of my 40/56gbps IPoIB: - There might be a bottleneck in the PCIe slots that my IB cards sit in (I have relatively small servers with only few PCI lanes and the available slots may have too few lanes to fully saturate the connections) -...
  12. P

    Looking for a "cheap" way to upgrade to 40gibt

    Yeah, well, I already have the expensive switch, so... And while the IB switch has way more ports than my 10gbe switch, I actually do need fewer of them because my IB cards only have two ports whereas my 10gbe cards have four. And the whole purpose of the exercise was to move data faster...
  13. P

    [SOLVED] Slow 40GBit Infiniband on Proxmox 8.1.4

    How/where did you buy the license? I thought, you can't buy that anymore because the switch is EOL...
  14. P

    Looking for a "cheap" way to upgrade to 40gibt

    Okay, so I got all three nodes to talk to each other over the new infiniband network. And my switch reports that all nodes are connected via 56gbps links (although I didn't purchase the more expensive cables :D) So that's a win. But the performance is underwhelming to say the least: 10gbps -...
  15. P

    Looking for a "cheap" way to upgrade to 40gibt

    Ah, found this: https://pve.proxmox.com/wiki/Infiniband And got the VPI card show up as an ethernet interface (while it is still being recognized by the switch). Getting closer...