Virtualizing PFSense through proxmox (plus how to install tar.gz file?)

[sheebz]

Hey everyone,

Is there a detailed walk through I can use to get pfsense virtualized on my server? I had a physical pfsense setup prior, but I’m super confused with the “virtualization” side of things.

I’ve got an hp proliant dl360p gen8 with dual sfp+ nic. Tried pci(e) passthrough, didn’t work. Tried running the modem (in bridge mode) to the server and connecting the second port to my switch, which also didn’t work.

I’m sure it’s just something stupid that I’m missing, I just can’t figure out what it is.

I’m also trying to install the HP update manager, which is a tar.gz file. Is there a simple way to install these by way of installing an app? I’m also confused with how to upload files to the directory…

Apologies for noob questions. I’m a windows guy and Linux is a whole new ball game

 

[Dunuin]

I’ve got an hp proliant dl360p gen8 with dual sfp+ nic. Tried pci(e) passthrough, didn’t work. Tried running the modem (in bridge mode) to the server and connecting the second port to my switch, which also didn’t work.

You would need to explain what exactly isn't working. Hundreds or thousands of people here run pfsense inside a VM so that is working fine. IF its not working you probalby doing something wrong but if you don't know what you exactly did, it is hard to help. How for example does your hosts network configuration looks like (cat /etc/network/interfaces).

I’m also trying to install the HP update manager, which is a tar.gz file. Is there a simple way to install these by way of installing an app?

tar.gz is an archive file like a zip. So you need to extract it first and then read the readme on how to install it. Probably inside is a deb file or a shell script to install it.

I’m also confused with how to upload files to the directory…

There is no way to manage files/folders (except for some special cases like ISOs) from within the WebUI. You do such stuff using the CLI or if you are on Windows you can use tools like WinSCP to upload/download/unzip/zip/move/copy/rename files without using CLI.

 

[sheebz]

Basically I can get pfsense installed, assign the interfaces, then I can’t get to the web gui to do anything. I’m not sure if I’m not setting up the passthrough properly or what

 

[sheebz]

You would need to explain what exactly isn't working. Hundreds or thousands of people here run pfsense inside a VM so that is working fine. IF its not working you probalby doing something wrong but if you don't know what you exactly did, it is hard to help. How for example does your hosts network configuration looks like (cat /etc/network/interfaces).

tar.gz is an archive file like a zip. So you need to extract it first and then read the readme on how to install it. Probably inside is a deb file or a shell script to install it.

There is no way to manage files/folders (except for some special cases like ISOs) from within the WebUI. You do such stuff using the CLI or if you are on Windows you can use tools like WinSCP to upload/download/unzip/zip/move/copy/rename files without using CLI.

basically right now my main goal is to get pfsense running since its been the biggest bain to my existence lol. ill check out that winscp program as well. that sounds like it should help!

i was half asleep when i read this when i woke up so apologies for the non descriptive response.

i will post the network interface stuff here soon. ive done a clean install after the last time my pfsense install screwed me, so i have no passthrough or anything done. all i've got is the bridges made

 

[sheebz]

You would need to explain what exactly isn't working. Hundreds or thousands of people here run pfsense inside a VM so that is working fine. IF its not working you probalby doing something wrong but if you don't know what you exactly did, it is hard to help. How for example does your hosts network configuration looks like (cat /etc/network/interfaces).

tar.gz is an archive file like a zip. So you need to extract it first and then read the readme on how to install it. Probably inside is a deb file or a shell script to install it.

There is no way to manage files/folders (except for some special cases like ISOs) from within the WebUI. You do such stuff using the CLI or if you are on Windows you can use tools like WinSCP to upload/download/unzip/zip/move/copy/rename files without using CLI.

part of my confusion lies with when my modem needs to be in bridge mode and where the modem gets plugged in to (switch or server - i've tried both)

when i install proxmox with the router in bridge mode, i choose my 192.168.x.x ip for proxmox, install updates, upload pfsense, start up vm, install, assign interfaces, get into GUI, create rules to allow traffic - but nothing works (no connection to pc's, xbox's, ap's - anything hardwired or wifi) and my computer says my connection can only talk with devices on the network.

when i install proxmox with the modem NOT in bridge mode, i can only get as far as the interface assignment screen in pfsense - since its pulling a different wan address from the modem/router. it pulls a 192.168.0.1 address i believe, maybe 192.168.1.1? so my lan cant lie in that address pool. i've done that and tried playing with manual ip's on my computer to match up and connect with it but that doesnt work either.

i have followed the pci and pcie passthrough guides for proxmox, i have all the virtualization stuff turned on in bios, i've tried plugging the modem into the switch and server and cant get it figured.

i've never actually done anything with the ISP modem/router before. whenever i get a new one i put it in bridge mode right away and hook up a 3rd party router. when i set up my custom pfsense box a couple years ago, i ran it from the 3rd party router so i never had any loss of connection while setting up pfsense, then just unplugged the router and ran straight through the box and it worked.

im honestly probably just missing some stupid step and flustering myself. but i've spent so much time getting this server working and to this point that im finally at the point where i actually need help on the virtualization part. this is my first dip into server and hypervisors. i know i've got lots to learn - and coming from being a windows knowitall, linux/debian is a completely different beast.

i just want my pfsense to work so i can finally take advantage of my 10g network haha

 

[Dunuin]

i have followed the pci and pcie passthrough guides for proxmox, i have all the virtualization stuff turned on in bios, i've tried plugging the modem into the switch and server and cant get it figured.

Did you followed this guide to setup PCI passthrough? Just activating stuff in BIOS isn't enough. You also need to add new parameters to the bootloader to tell it to actually allow PCI passthrough. You need to rebuild your grub/systemd and initramfs and maybe even block some drivers or devices so your host won't try to initialize it while booting so its uninitialized when passed through later to the VM so you pfsense can initialize it (but I think thats more important for GPUs). And then you can't passthrough any device. You can only passthrough complete IOMMU groups so each device should be alone in its own group. But if your NICs are onboard it might be possible that the mainboard is designed that way, that the onboard NICs will share the same IOMMU group with some other stuff, like for example a memory controller. If you then try to passthrough that group to a VM it will not just passthrough the NIC but also the memory controller and then your host crashes because it can't use the memory anymore. Its easier to use dedicated PCIe NICs. But not every PCIe slot might have its own group either. In such a case it might work to put the NIC in different PCIe slots until you find a PCIe slot where the NIC will get its own private group.

Also keep in mind, when following that wiki article, that you need to use different command depending on if your server boots using GRUB (BIOS/UEFI with CSM enabled) or systemd (UEFI with CSM disabled).

 

[sheebz]

Did you followed this guide to setup PCI passthrough? Just activating stuff in BIOS isn't enough. You also need to add new parameters to the bootloader to tell it to actually allow PCI passthrough. You need to rebuild your grub/systemd and initramfs and maybe even block some drivers or devices so your host won't try to initialize it while booting so its uninitialized when passed through later to the VM so you pfsense can initialize it (but I think thats more important for GPUs). And then you can't passthrough any device. You can only passthrough complete IOMMU groups so each device should be alone in its own group. But if your NICs are onboard it might be possible that the mainboard is designed that way, that the onboard NICs will share the same IOMMU group with some other stuff, like for example a memory controller. If you then try to passthrough that group to a VM it will not just passthrough the NIC but also the memory controller and then your host crashes because it can't use the memory anymore. Its easier to use dedicated PCIe NICs. But not every PCIe slot might have its own group either. In such a case it might work to put the NIC in different PCIe slots until you find a PCIe slot where the NIC will get its own private group.

Also keep in mind, when following that wiki article, that you need to use different command depending on if your server boots using GRUB (BIOS/UEFI with CSM enabled) or systemd (UEFI with CSM disabled).

yes i followed both these guides for pci and for pcie. i did the grub update, but when i updated the initramfs i did keep getting errors. may have been because my subscription wasnt active at that time on the server so it could've been trying to pull something from the enterprise repo? not sure. i blocked the driver as well.

when i brought up the iommu groups, they were separated. something like iommu group 8 - 00:03.0, iommu group 9 - 00:03.1. so i think those were fine.

i will post a picture of the nic and where its plugged in to. i dont think im able to plug it into anything directly on the board. its like a removeable bracket with the pci slots on it (sorry, new to servers so dont know the name of what it is). the server came with a 4 port gb nic, but i swapped it out for a dual 10g sfp+ nic. drivers are all installed and its working fine. i installed it in the slot the original nic was in, but there is another slot on the opposite side of the bracket but it sits further back so the ports arent flush with the back of the server.

and yes, i followed the commands for grub (plus i installed pfsense to boot with bios), but whats the csm part? that doesnt sound familiar...

 

[sheebz]

 

[Dunuin]

And yes, i followed the commands for grub (plus i installed pfsense to boot with bios), but whats the csm part? that doesnt sound familiar...

CSM is the "Compatibility Support Module". If you enable it you basically add backwards compability so your UEFI mainboard can boot from grub just like a BIOS mainboard. If its disabled your mainboard will need to boot from an ESP instead.

Looks like you got a PCIe 16x and a PCIe 8x slot.

If you couldn't update the initramfs that would explain why you wasn't able to use PCI passthrough. Without updating the bootloader and initramfs your changes won't applied.

 

[sheebz]

k ill look into this csm thing and ill try the passthrough again with my subscription active and report back haha

 

[Dunuin]

You don't need to change CSM or otherwise your installed PVE possibly won't boot anymore. Its just important to know how you are booting to use the correct commands.

 

[sheebz]

CSM is the "Compatibility Support Module". If you enable it you basically add backwards compability so your UEFI mainboard can boot from grub just like a BIOS mainboard. If its disabled your mainboard will need to boot from an ESP instead.

Looks like you got a PCIe 16x and a PCIe 8x slot.

If you couldn't update the initramfs that would explain why you wasn't able to use PCI passthrough. Without updating the bootloader and initramfs your changes won't applied.

all i can find on csm for my server is legacy mode? is that what i need to enable? because ahci is enabled by default

 

[sheebz]

You don't need to change CSM or otherwise your installed PVE possibly won't boot anymore. Its just important to know how you are booting to use the correct commands.

oh so its fine if i dont have it enabled?

 

[sheebz]

this is what i get when i update initramfs

 

[Dunuin]

There is no error. It just tells you it will skip the ESP sync, which you don'T need, because you use grub with BIOS and not UEFI with ESP.

So whats your output of dmesg | grep -e DMAR -e IOMMU, find /sys/kernel/iommu_groups/ -type l and lspci?

 

[sheebz]

ahh ok
well i tried doing the passthrough again last night and i can no longer get into the web gui or ssh lol. so i've gotta figure out how to get in there or reverse everything i did i guess

 

[sheebz]

i think blacklisting the nic driver killed my connection

root@gravemind:~# find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/108/devices/0000:3f:11.0
/sys/kernel/iommu_groups/55/devices/0000:1f:10.5
/sys/kernel/iommu_groups/83/devices/0000:3f:08.3
/sys/kernel/iommu_groups/17/devices/0000:00:04.6
/sys/kernel/iommu_groups/45/devices/0000:1f:0f.2
/sys/kernel/iommu_groups/73/devices/0000:20:04.2
/sys/kernel/iommu_groups/35/devices/0000:1f:09.0
/sys/kernel/iommu_groups/7/devices/0000:00:03.0
/sys/kernel/iommu_groups/63/devices/0000:20:02.0
/sys/kernel/iommu_groups/91/devices/0000:3f:0d.3
/sys/kernel/iommu_groups/91/devices/0000:3f:0d.1
/sys/kernel/iommu_groups/91/devices/0000:3f:0d.6
/sys/kernel/iommu_groups/91/devices/0000:3f:0d.2
/sys/kernel/iommu_groups/91/devices/0000:3f:0d.0
/sys/kernel/iommu_groups/25/devices/0000:00:1c.7
/sys/kernel/iommu_groups/106/devices/0000:3f:10.6
/sys/kernel/iommu_groups/53/devices/0000:1f:10.3
/sys/kernel/iommu_groups/81/devices/0000:20:05.4
/sys/kernel/iommu_groups/15/devices/0000:00:04.4
/sys/kernel/iommu_groups/43/devices/0000:1f:0f.0
/sys/kernel/iommu_groups/71/devices/0000:20:04.0
/sys/kernel/iommu_groups/33/devices/0000:1f:08.3
/sys/kernel/iommu_groups/5/devices/0000:00:02.2
/sys/kernel/iommu_groups/61/devices/0000:20:01.0
/sys/kernel/iommu_groups/23/devices/0000:00:1a.0
/sys/kernel/iommu_groups/104/devices/0000:3f:10.4
/sys/kernel/iommu_groups/51/devices/0000:1f:10.1
/sys/kernel/iommu_groups/13/devices/0000:00:04.2
/sys/kernel/iommu_groups/41/devices/0000:1f:0d.6
/sys/kernel/iommu_groups/41/devices/0000:1f:0d.2
/sys/kernel/iommu_groups/41/devices/0000:1f:0d.0
/sys/kernel/iommu_groups/41/devices/0000:1f:0d.3
/sys/kernel/iommu_groups/41/devices/0000:1f:0d.1
/sys/kernel/iommu_groups/98/devices/0000:3f:0f.5
/sys/kernel/iommu_groups/31/devices/0000:03:00.0
/sys/kernel/iommu_groups/31/devices/0000:03:00.1
/sys/kernel/iommu_groups/3/devices/0000:00:02.0
/sys/kernel/iommu_groups/88/devices/0000:3f:0a.3
/sys/kernel/iommu_groups/88/devices/0000:3f:0a.1
/sys/kernel/iommu_groups/88/devices/0000:3f:0a.2
/sys/kernel/iommu_groups/88/devices/0000:3f:0a.0
/sys/kernel/iommu_groups/21/devices/0000:00:05.4
/sys/kernel/iommu_groups/102/devices/0000:3f:10.2
/sys/kernel/iommu_groups/78/devices/0000:20:04.7
/sys/kernel/iommu_groups/11/devices/0000:00:04.0
/sys/kernel/iommu_groups/68/devices/0000:20:03.1
/sys/kernel/iommu_groups/96/devices/0000:3f:0f.3
/sys/kernel/iommu_groups/1/devices/0000:00:01.0
/sys/kernel/iommu_groups/58/devices/0000:1f:11.0
/sys/kernel/iommu_groups/86/devices/0000:3f:09.3
/sys/kernel/iommu_groups/100/devices/0000:3f:10.0
/sys/kernel/iommu_groups/48/devices/0000:1f:0f.5
/sys/kernel/iommu_groups/76/devices/0000:20:04.5
/sys/kernel/iommu_groups/38/devices/0000:1f:0a.2
/sys/kernel/iommu_groups/38/devices/0000:1f:0a.0
/sys/kernel/iommu_groups/38/devices/0000:1f:0a.3
/sys/kernel/iommu_groups/38/devices/0000:1f:0a.1
/sys/kernel/iommu_groups/66/devices/0000:20:02.3
/sys/kernel/iommu_groups/94/devices/0000:3f:0f.1
/sys/kernel/iommu_groups/28/devices/0000:00:1f.2
/sys/kernel/iommu_groups/28/devices/0000:00:1f.0
/sys/kernel/iommu_groups/109/devices/0000:3f:13.0
/sys/kernel/iommu_groups/109/devices/0000:3f:13.5
/sys/kernel/iommu_groups/109/devices/0000:3f:13.1
/sys/kernel/iommu_groups/109/devices/0000:3f:13.6
/sys/kernel/iommu_groups/109/devices/0000:3f:13.4
/sys/kernel/iommu_groups/56/devices/0000:1f:10.6
/sys/kernel/iommu_groups/84/devices/0000:3f:08.4
/sys/kernel/iommu_groups/18/devices/0000:00:04.7
/sys/kernel/iommu_groups/46/devices/0000:1f:0f.3
/sys/kernel/iommu_groups/74/devices/0000:20:04.3
/sys/kernel/iommu_groups/36/devices/0000:1f:09.3
/sys/kernel/iommu_groups/8/devices/0000:00:03.1
/sys/kernel/iommu_groups/64/devices/0000:20:02.1
/sys/kernel/iommu_groups/92/devices/0000:3f:0e.1
/sys/kernel/iommu_groups/92/devices/0000:3f:0e.0
/sys/kernel/iommu_groups/26/devices/0000:00:1d.0
/sys/kernel/iommu_groups/107/devices/0000:3f:10.7
/sys/kernel/iommu_groups/54/devices/0000:1f:10.4
/sys/kernel/iommu_groups/82/devices/0000:3f:08.0
/sys/kernel/iommu_groups/16/devices/0000:00:04.5
/sys/kernel/iommu_groups/44/devices/0000:1f:0f.1
/sys/kernel/iommu_groups/72/devices/0000:20:04.1
/sys/kernel/iommu_groups/34/devices/0000:1f:08.4
/sys/kernel/iommu_groups/6/devices/0000:00:02.3
/sys/kernel/iommu_groups/62/devices/0000:20:01.1
/sys/kernel/iommu_groups/90/devices/0000:3f:0c.2
/sys/kernel/iommu_groups/90/devices/0000:3f:0c.0
/sys/kernel/iommu_groups/90/devices/0000:3f:0c.7
/sys/kernel/iommu_groups/90/devices/0000:3f:0c.3
/sys/kernel/iommu_groups/90/devices/0000:3f:0c.1
/sys/kernel/iommu_groups/90/devices/0000:3f:0c.6
/sys/kernel/iommu_groups/24/devices/0000:00:1c.0
/sys/kernel/iommu_groups/105/devices/0000:3f:10.5
/sys/kernel/iommu_groups/52/devices/0000:1f:10.2
/sys/kernel/iommu_groups/80/devices/0000:20:05.2
/sys/kernel/iommu_groups/14/devices/0000:00:04.3
/sys/kernel/iommu_groups/42/devices/0000:1f:0e.0
/sys/kernel/iommu_groups/42/devices/0000:1f:0e.1
/sys/kernel/iommu_groups/70/devices/0000:20:03.3
/sys/kernel/iommu_groups/99/devices/0000:3f:0f.6
/sys/kernel/iommu_groups/32/devices/0000:1f:08.0
/sys/kernel/iommu_groups/4/devices/0000:00:02.1
/sys/kernel/iommu_groups/60/devices/0000:20:00.0
/sys/kernel/iommu_groups/89/devices/0000:3f:0b.0
/sys/kernel/iommu_groups/89/devices/0000:3f:0b.3
/sys/kernel/iommu_groups/22/devices/0000:00:11.0
/sys/kernel/iommu_groups/103/devices/0000:3f:10.3
/sys/kernel/iommu_groups/50/devices/0000:1f:10.0
/sys/kernel/iommu_groups/79/devices/0000:20:05.0
/sys/kernel/iommu_groups/12/devices/0000:00:04.1
/sys/kernel/iommu_groups/40/devices/0000:1f:0c.3
/sys/kernel/iommu_groups/40/devices/0000:1f:0c.1
/sys/kernel/iommu_groups/40/devices/0000:1f:0c.6
/sys/kernel/iommu_groups/40/devices/0000:1f:0c.2
/sys/kernel/iommu_groups/40/devices/0000:1f:0c.0
/sys/kernel/iommu_groups/40/devices/0000:1f:0c.7
/sys/kernel/iommu_groups/69/devices/0000:20:03.2
/sys/kernel/iommu_groups/97/devices/0000:3f:0f.4
/sys/kernel/iommu_groups/30/devices/0000:02:00.0
/sys/kernel/iommu_groups/2/devices/0000:00:01.1
/sys/kernel/iommu_groups/59/devices/0000:1f:13.1
/sys/kernel/iommu_groups/59/devices/0000:1f:13.6
/sys/kernel/iommu_groups/59/devices/0000:1f:13.4
/sys/kernel/iommu_groups/59/devices/0000:1f:13.0
/sys/kernel/iommu_groups/59/devices/0000:1f:13.5
/sys/kernel/iommu_groups/87/devices/0000:3f:09.4
/sys/kernel/iommu_groups/20/devices/0000:00:05.2
/sys/kernel/iommu_groups/101/devices/0000:3f:10.1
/sys/kernel/iommu_groups/49/devices/0000:1f:0f.6
/sys/kernel/iommu_groups/77/devices/0000:20:04.6
/sys/kernel/iommu_groups/10/devices/0000:00:03.3
/sys/kernel/iommu_groups/39/devices/0000:1f:0b.0
/sys/kernel/iommu_groups/39/devices/0000:1f:0b.3
/sys/kernel/iommu_groups/67/devices/0000:20:03.0
/sys/kernel/iommu_groups/95/devices/0000:3f:0f.2
/sys/kernel/iommu_groups/29/devices/0000:01:00.4
/sys/kernel/iommu_groups/29/devices/0000:01:00.2
/sys/kernel/iommu_groups/29/devices/0000:01:00.0
/sys/kernel/iommu_groups/29/devices/0000:01:00.1
/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/57/devices/0000:1f:10.7
/sys/kernel/iommu_groups/85/devices/0000:3f:09.0
/sys/kernel/iommu_groups/19/devices/0000:00:05.0
/sys/kernel/iommu_groups/47/devices/0000:1f:0f.4
/sys/kernel/iommu_groups/75/devices/0000:20:04.4
/sys/kernel/iommu_groups/37/devices/0000:1f:09.4
/sys/kernel/iommu_groups/9/devices/0000:00:03.2
/sys/kernel/iommu_groups/65/devices/0000:20:02.2
/sys/kernel/iommu_groups/93/devices/0000:3f:0f.0
/sys/kernel/iommu_groups/27/devices/0000:00:1e.0

 

[sheebz]

root@gravemind:~# lspci
00:00.0 Host bridge: Intel Corporation Xeon E5/Core i7 DMI2 (rev 07)
00:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07)
00:01.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1b (rev 07)
00:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a (rev 07)
00:02.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2b (rev 07)
00:02.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2c (rev 07)
00:02.3 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2d (rev 07)
00:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07)
00:03.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3b (rev 07)
00:03.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3c (rev 07)
00:03.3 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3d (rev 07)
00:04.0 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 0 (rev 07)
00:04.1 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 1 (rev 07)
00:04.2 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 2 (rev 07)
00:04.3 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 3 (rev 07)
00:04.4 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 4 (rev 07)
00:04.5 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 5 (rev 07)
00:04.6 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 6 (rev 07)
00:04.7 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 7 (rev 07)
00:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07)
00:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07)
00:05.4 PIC: Intel Corporation Xeon E5/Core i7 I/O APIC (rev 07)
00:11.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port (rev 05)
00:1a.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 (rev 05)
00:1c.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 (rev b5)
00:1c.7 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 8 (rev b5)
00:1d.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 (rev 05)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
00:1f.0 ISA bridge: Intel Corporation C600/X79 series chipset LPC Controller (rev 05)
00:1f.2 SATA controller: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller (rev 05)
01:00.0 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Slave Instrumentation & System Support (rev 05)
01:00.1 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200EH
01:00.2 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Management Processor Support and Messaging (rev 05)
01:00.4 USB controller: Hewlett-Packard Company Integrated Lights-Out Standard Virtual USB Controller (rev 02)
02:00.0 RAID bus controller: Hewlett-Packard Company Smart Array Gen8 Controllers (rev 01)
03:00.0 Ethernet controller: Broadcom Limited NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
03:00.1 Ethernet controller: Broadcom Limited NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
1f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07)
1f:08.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07)
1f:08.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07)
1f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07)
1f:09.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07)
1f:09.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07)
1f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07)
1f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07)
1f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07)
1f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07)
1f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07)
1f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07)
1f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0c.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07)
1f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07)
1f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0d.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
1f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07)
1f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07)

 

[sheebz]

1f:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07)
1f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07)
1f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07)
1f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07)
1f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07)
1f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07)
1f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07)
1f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07)
1f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
1f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07)
1f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07)
1f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07)
1f:10.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 (rev 07)
1f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07)
1f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07)
1f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07)
1f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07)
1f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07)
1f:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07)
1f:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07)
1f:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07)
1f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)
20:00.0 PCI bridge: Intel Corporation Xeon E5/Core i7 DMI2 in PCI Express Mode (rev 07)
20:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07)
20:01.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1b (rev 07)
20:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a (rev 07)
20:02.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2b (rev 07)
20:02.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2c (rev 07)
20:02.3 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2d (rev 07)
20:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07)
20:03.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3b (rev 07)
20:03.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3c (rev 07)
20:03.3 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3d (rev 07)
20:04.0 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 0 (rev 07)
20:04.1 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 1 (rev 07)
20:04.2 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 2 (rev 07)
20:04.3 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 3 (rev 07)
20:04.4 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 4 (rev 07)
20:04.5 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 5 (rev 07)
20:04.6 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 6 (rev 07)
20:04.7 System peripheral: Intel Corporation Xeon E5/Core i7 DMA Channel 7 (rev 07)
20:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07)
20:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07)
20:05.4 PIC: Intel Corporation Xeon E5/Core i7 I/O APIC (rev 07)
3f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07)
3f:08.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07)
3f:08.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07)
3f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07)
3f:09.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07)
3f:09.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07)
3f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07)
3f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07)
3f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07)
3f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07)
3f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07)
3f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07)
3f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07)
3f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07)
3f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07)
3f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07)
3f:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07)
3f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07)
3f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07)
3f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07)
3f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07)
3f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07)
3f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07)
3f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07)
3f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
3f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07)
3f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07)
3f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07)
3f:10.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 (rev 07)
3f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07)
3f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07)
3f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07)
3f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07)
3f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07)
3f:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07)
3f:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07)
3f:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07)
3f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)

 

[bobmc]

There's an official 'how to' here

https://docs.netgate.com/pfsense/en/latest/recipes/virtualize-proxmox-ve.html

I think trying to do pci pass-through here is unhelpful and un-necessary