ASM2812 based dual NVME PCIe card and passthrough

M

Miesepies

New Member
May 23, 2025
5
0
1
Hi all,

I have a TXB122, a PCIe 3.1 ASM2812 based dual NVME PCIe card in a Minisforum MS-01. The MS-01 has a 8 lanes PCIe slot, but does not support bifurcation (hence the ASM2812 solution). Running Proxmox 8.4.1. Following the documentation I have configured passhtrough and added the 2 drives as a PCIe device to a VM. Each ssd has it's own id and iommugroup. This looks to be working fine, and both NVME ssd's are visible in the VM.

But as soon as I copy data to a disk, at some point speeds drops to zero and effectively hangs. Sometimes it takes a couple of minutes, but sometimes it freezes immediately. Running with a single NVME placed on the card usually works but with 2 drives it's guaranteed to freeze.

If I boot Windows or Debian directly on the MS-01, the 2 ssd's on the card work just fine. No freezes whatsoever.

Does anybody here have experience with a ASM2812 based PCIe card and passthrough? The ASM2812 is sort of a workaround for bifurcation. It shows 2 seperate devices to the system, but are they really? Any tips, or workarounds?
 
Last edited:
After a copy job freezes and I try to shutdown the VM, more than once Proxmox rebooted. Nothing is registered in the system log except for a reboot entry.

When adding PCI devices, I tried switching All functions and PCI Express options.
 
I guess not many here use a ASM2812 based card in combination with passthrough.

Errors when accessing one of the NVME disks from the PCIe card:

Code: 
Jun 02 20:59:23 pm01 kernel: DMAR: DRHD: handling fault status reg 3
Jun 02 20:59:23 pm01 kernel: DMAR: [DMA Read NO_PASID] Request device [03:00.0] fault addr 0x7fffffff000 [fault reason 0x04] Access beyond MGAW

I am able to use the PCIe card with a single NVME disk and mapped to a VM. I just can't use the second slot.
So I might be better of with just a plain single m.2 to PCIe card...
 
Last edited:
No, unfortunately not.
As far as I know, there are no issues using the 2 disks on the card locally on Proxmox, so you could probably use some form of sharing or folder mapping to store and access data or use the disks as virtual disk storage and have all data and/or VM's stored on the virtual disks.
 
Last edited:
Well, darn.. I too have been planning essentially this setup using an MS-01 but it feels like that isn't happening

Is it so much to ask for a cheap (relatively), low power, 10GbE device that can support passthru of a dedicated nvme controller (with >= 3 nvme slots) ? :)

The Beelink ME Mini would be great if it supported 10GbE.. Not sure about passthru support, but for the price I'd forego proxmox and let it be a standalone TrueNAS box. I'm vaguely hoping the forthcoming ME Max or ME Pro gives us something worth looking at..
 
Perhaps asmedia's ASM118x, ASM18xx, and ASM28xx are all not working correctly.

I used ASM1184e and pcie stopped working.

The other chips PEX8724 seem to be working fine.
 
You must log in or register to reply here.
Top Bottom