Search results

  1. N

    [TUTORIAL] Enabling SR-IOV for Intel NIC (X550-T2) on Proxmox 6

    Again, might be solarflare specific. I had to learn everything from the Solarflare PDF. So check the Intel user guide for your card as well.
  2. N

    [TUTORIAL] Enabling SR-IOV for Intel NIC (X550-T2) on Proxmox 6

    My script ofcourse is for Solarflare cards, and with those, i first have to use the solarflare sfboot utility to set my card in sr-iov / full virtualisation mode, and alse define max number of VF's per port. So i'm not familiar with the X550-T2, but first thing you should check is if there is...
  3. N

    [TUTORIAL] Enabling SR-IOV for Intel NIC (X550-T2) on Proxmox 6

    edit: using Requires=network.target might be abit wrong here, i'm still working on perfecting the script. The example above does start the service at the correct time, but reading https://systemd.io/NETWORK_ONLINE/ says it really should be Before=network-pre.target and Wants=network-pre.target...
  4. N

    [TUTORIAL] Enabling SR-IOV for Intel NIC (X550-T2) on Proxmox 6

    If you previous OPNsense used the physical MAC addresses of your interfaces, and you want to now use those MAC addresses on a VF instead, then what you would have to do is first save the original addresses, and then change the MAC addresses of the physical interfaces. After that you could use...
  5. N

    [TUTORIAL] Enabling SR-IOV for Intel NIC (X550-T2) on Proxmox 6

    Hi. "echo 2 > ...sriov_numvfs" creates 2 VF's (virtual functions) for the interface you do it to. Those interfaces is what you then would pass through to OPNsense. Each time you partition a physical interface like that, it will be assigned a random MAC address. So you have to have the script...
  6. N

    VirtioFS support

    Well, there's something called 9pfs, which recently got a major performance improvement https://wiki.qemu.org/Documentation/9p https://www.phoronix.com/news/QEMU-7.2-Released My main complaint is with linux overall, sure you can build something functional, but only using hours, days, weeks and...
  7. N

    VirtioFS support

    for me as virtiofs doesn't support NUMA (VM won't start with NUMA enabled just as user lpfister9 says, it's basically useless. The Intel docs i linked to describe how to tie hugepages to a specific NUMA slot, but virtiofs don't care, and as such is useless. virtiofs is useless, and basically as...
  8. N

    VirtioFS support

    Hello, i asked about this from a linux openzfs developer, and he says it will probably not work, and then said that he is planning to start using virtiofs himself at some point, and when he does he will take a look at DAX, and the possibility of adding openzfs support for it.
  9. N

    VirtioFS support

    Hello, i'm about to try this, and i will read up on https://virtio-fs.gitlab.io/howto-qemu.html but just wanted to ask in advance, if you actually tried enabling NUMA, and what happened? I want to use virtiofs in a VM that has NUMA enabled, and has cpu pinning because it has a GPU with pcie...
  10. N

    CPU pinning?

    I know i'm repeating myself, but imo i think adding numactl options to simply bind a VM to a NUMA node, and to the RAM attached to that node would be an alternative more simple solution, as from what i understand the linux kernel is very good at choosing which cores to utilize automatically. I...
  11. N

    CPU pinning?

    Well as @Dot 's patches now have been accepted, you can now try pinning your GPU passthrough VM to certain cores. The main idea is to use the cores of the CPU that the PCIE lanes are connected to. I don't know how the the AMD cpu's work, but you can install hwloc, which includes lstopo, which...
  12. N

    CPU pinning?

    Just updated PVE and now i see CPU AFFINITY setting. Great work @Dot, congratulations.. Now about those numactl settings.. :D
  13. N

    CPU pinning?

    So did the micro stuttering stop with numactl pinning as well? My aim is to find out if pinning cores is really necessary, versus pinning numa nodes, in order to simplify setups, and not needing to "count and manage cores" Also once again i'm an amateur in this, what i'd like to know is how to...
  14. N

    CPU pinning?

    Hi, again i must state i'm no expert.. but a few things keep bothering me about this pinning stuff. Most of the people here that want to pin processes to certain cores need it for gaming setups, or to get maximum performance of other pcie devices such as storage controllers or nvme disks. But...
  15. N

    CPU pinning?

    Edit2: to add to my questions below, i'm not sure that taskset is the correct tool to use for this issue at all. It seems to me that in the beginning of this thread the taskset tool was chosen without much consideration at all: from taskset manpage: And from numactl manpages: So i ask, are...
  16. N

    [TUTORIAL] Enabling SR-IOV for Intel NIC (X550-T2) on Proxmox 6

    Hello, and thankyou @Sandbo for giving me a starting point. I have expanded the service a bit to use with my Solarflare SFN7022 NIC's Blacklisting the sfc.ko driver was not an option for me, since host uses the physical NIC ports as well, plus that would prevent me from creating more VF's on the...
  17. N

    hugepages or anon hugepages

    Thankyou for this. Based on your response i also find it not worth implementing on my setup. I try to implement all reasonable optimisations, but with a focus on usability and stability, 10% extra performance for the price of a highly 'undynamic' system is not worth it. My case is a 2x Xeon...
  18. N

    hugepages or anon hugepages

    Hello, i wanted to quickly ask, should i still enable hugepages by adding hugepagesz=1G default_hugepagesz=1G to KCL in latest PVE? I can't find alot of information about anon hugepages, and if it's still recommended to add the above kernel command line.. Thx.
  19. N

    CPU pinning?

    It would be nice to be able to set this in the CPU settings for VM, but in the meantime i found this https://github.com/ayufan/pve-helpers It allows you to assign cpu cores to a VM, as well as set irq affinity using the 'Notes' area for a VM. Edit: based on preliminary testing, with a USB...
  20. N

    CPU pinning?

    Hello I'm running a VM with pcie passthrough to a nvidia quadro GPU, and trying to set cpu and ram affinity to the same NUMA node that hosts the GPU (numa 0) It's my understanding both the RAM and the CPU's should be run only on the same NUMA node the GPU is attached to.. As i understand it...