Search results

  1. R

    [SOLVED] Not working: Mellanox Technologies MT27520 Family [ConnectX-3 Pro]

    As far i remember, all mellanox connect-x3 and 4 Cards from HPe have a vlan bug. So vmbr with slave port/bond of connect-x3/4, will never be vlan aware. At least it won't work. Unless you put the slave ports into Promisc-Mode. I had this on a lot of HPe Mellanox Cards, that why im avoiding...
  2. R

    raidz from 4 disk to 3 is it possible?

    Maybe one more Tip. People (me in the beginnings either) are fixed to buy the exact same drive as replacement. Let me say it that way: If you can get a larger/better disk, same or more cachesize... So in general if specs are at least same, or better... Most important is that the new disk is...
  3. R

    Hardware Feedback - Proxmox Ceph Cluster (3-4 nodes)

    You are right, i have to dig further in. I don't say that there is no way around that, just no easy one. The easiest one is CPU Pinning, which is possible on Proxmox without a lot of knowledge and you don't need even to change bios settings for that, like enabling NPS4 or Numa per L3 Cache...
  4. R

    Hardware Feedback - Proxmox Ceph Cluster (3-4 nodes)

    Its called split tables or something like that and it is available on any genoa/milan, but you'll get usually 8 or even 16 numa domains per CPU, depending on the core count. Each Domain per L3-Cache. Each domain has only 8 cores. To manage this with cpu pinning, without the support that proxmox...
  5. R

    Hardware Feedback - Proxmox Ceph Cluster (3-4 nodes)

    Thats not correct. Phoronix test suite is very optimized edge case benchmarking. Almost everything has nothing todo with real world. Proxmox doesn't support numa or it's completely broken with amd CPUs, as long that is the case, you cannot get 100% of the performance in any multi threading...
  6. R

    Hardware Feedback - Proxmox Ceph Cluster (3-4 nodes)

    I have those servers, they are good. Bios updates are good and the Hardware is good. And additionally the Server Section has Nothing todo with the Customer Section, completely different department/support etc. There are other Barebones, from Gigabyte/Asrock and a lot more. Even from Supermicro...
  7. R

    Hardware Feedback - Proxmox Ceph Cluster (3-4 nodes)

    Ah and i forgot, they are very loud, on normal load so 99% of the time, the fans spin at 7280rpm, which is somewhat okay. On full load they spin at 17k RPM and that sounds like a plane next to you. But that are 400W cpus, so it's expected
  8. R

    Hardware Feedback - Proxmox Ceph Cluster (3-4 nodes)

    I bet this is around 30k usd/eur ? You get for that money already 3x genoa servers, each with: Asus rs520a-e12-rs12u 9274F + 12x 32gb ddr-5 memory (384gb) + Intel E810 + 12x micron 7450/7500 pro 4TB + 2x pm9a3 2tb for OS in m.2 110 formfactor. I would go with 9374F and 64gb dimms, but that's...
  9. R

    NUMA questions again

    Check my thread. https://forum.proxmox.com/threads/iperf3-speed-same-node-vs-2-nodes-found-a-bug.146805 Especially my last 2 posts. Iperf without Numa = 14GB/s Iperf with Numa = 40GB/s that is everything else but not "negligible" Right now, i have no other ways, other than using CPU Pinning...
  10. R

    NUMA questions again

    available: 4 nodes (0-3) node 0 cpus: 0 1 2 3 4 5 6 7 32 33 34 35 36 37 38 39 node 0 size: 193205 MB node 0 free: 133719 MB node 1 cpus: 8 9 10 11 12 13 14 15 40 41 42 43 44 45 46 47 node 1 size: 193530 MB node 1 free: 184164 MB node 2 cpus: 16 17 18 19 20 21 22 23 48 49 50 51 52 53 54 55 node 2...
  11. R

    NUMA questions again

    I have another question. Lets say if i give a VM, 4 vCPU's and the host have 4 Numa Domains, each domain with 16 Cores. Will Proxmox then favorize/pin the 4 vCPUS's/Threads to one Numa Domain of the host? If yes, then it would be amazing, because the VM can be old/outdated etc and the...
  12. R

    Secure Boot - Doesn't work (Specific issue)

    I reflashed the Bios xD That disabled secure boot, glad god and i can boot again. However, the question still remains, there is no shim entry and i don't have a clue why the proxmox-boot-tool doesn't generate it.
  13. R

    Secure Boot - Doesn't work (Specific issue)

    Proxmox 8.2.2/Kernel 6.8.4-3 Hi, i run into the issue, that i enabled secure boot afterwards on one Genoa-Server. And the issue is, seems to me like a bios bug, i can't deactivate it. Disabling/Clearing Keys/whatever, reset bios to defaults (default is disabled) saving changes and reboot and...
  14. R

    Linux 6.9 Features: DM VDO, AMD Preferred Core, Intel FRED & Larger Console Fonts

    i completely forgot about that xD but yeah absolutely right.
  15. R

    Help diagnosing ZFS storage issues

    That's a good advice from gfngfn256. Worth definitively a try. But tbh, i think now that a drive is somehow dead or have huge issues with writing/deleting. Maybe even more as one, but let's see. At least if you get your data moved somewhere else (backup etc) and destroy the pool, you can then...
  16. R

    Pve-kernel amd pstate not working (the _CPC object is not present)

    Forget asrock, i have the x570d4i-2t. They have even less clue about the bios as you, believe me. But at least they will give an Answer, im curious if they will just tell you "Reset your BIOS Settings to Optimized Defaults" or something different :) But i never seen anyone, who have even broken...
  17. R

    Pve-kernel amd pstate not working (the _CPC object is not present)

    I never tryed passive/guided tbh, so i don't know how the output should look like. I can just say that with active (epp), i do have all frequencies, except the "current CPU frequency", i get the unable to call hardware too. But for passive i have no clue. Did you tryed to set the sheduler to...
  18. R

    Pve-kernel amd pstate not working (the _CPC object is not present)

    Im using an Arc380 (for transcoding) too, you don't need resizable bar, especially not for transcoding.
  19. R

    Pve-kernel amd pstate not working (the _CPC object is not present)

    About the new Bios: Dont use Resizable Bar or Above 4G, with Proxmox. No matter if you passthrough your GPU or use it for encoding, it will usually have the reset bug. And you don't gain anything from on Proxmox anyway. Cheers
  20. R

    Pve-kernel amd pstate not working (the _CPC object is not present)

    amd_pstate: failed to register with return -19 With amd_pstate=active ? But passive/guided (which is the same) works? Thats a Completely new issue i never seen before. This patch is not part of our PVE 6.8.4 Kernel: https://bugzilla.kernel.org/show_bug.cgi?id=218171 I have 2 Systems, one Ryzen...