[January 2026] NVME over TCP (over Fabric?) Support in Proxmox 9?

SInisterPisces

SInisterPisces

Well-Known Member
Proxmox Subscriber
Sep 1, 2022
499
191
48
41
Note: My question focuses on NVME over TCP because that's what I have access to in TrueNAS. I don't have a way to tinker with NVME over Fabric more generally.

Hello,

TrueNAS 25.10 Community Edition (SCALE) introduces support for NVME over TCP as an alternative to iSCSI.

My current understanding is that it's possible to use this in Proxmox 9, today, by manually setting up the NVME over TCP storage on the CLI using standard Debian 13 tools, but it's not really integrated into PVE Storage Manager yet.

Is that correct? If so, what PVE storage features don't yet work with NVME over TCP? For example, I suspect that without PVE Storage Manager integration, snapshots and backups might not work, and that PVE might not be able to correctly read used/free storage space.
 
Hi @SInisterPisces ,

From an operating system perspective, an NVMe/TCP-connected disk and an iSCSI disk both present themselves as raw block devices. When you use the native OS tools to manage them (iscsiadm for iSCSI and nvme for NVMe/TCP), their behavior and feature sets are largely comparable. For example, direct storage-level snapshots are not supported by either approach.

Free and used space reporting is identical for disks connected via either protocol, and PVE backups are handled in exactly the same way.

You can also use the QCOW2 layer on top of either type of disk. The main difference is in management integration: the iscsi storage pool type can be natively supported by PVE, whereas NVMe/TCP storage must currently be managed manually.

At higher management layers, specifically when using storage-vendor-provided plugins, you may be able to unlock additional features and functionality with either option.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
I do not understand why Proxmox team does not include NVMe/TCP within PVE UI. I understand that NVMe/TCP can be used with CLI, but it would be a great feature to have easily accessible.
 
robertlukan said:
I do not understand why Proxmox team does not include NVMe/TCP within PVE UI.
Click to expand...
It's probably a matter of priority. Of course it would be nice to have everything, however the team likely balances between: availability, stability, net new functionality, and pretty GUI for things that already work.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
  • Like
Reactions: SInisterPisces
robertlukan said:
I do not understand why Proxmox team does not include NVMe/TCP within PVE UI. I understand that NVMe/TCP can be used with CLI, but it would be a great feature to have easily accessible.
Click to expand...
Same with general multipath and also with fiberchannel. Things are probably just to complex to have a simple UI to setup everything.
 
You must log in or register to reply here.
Top Bottom