[SOLVED] Proxmox does not recognize nvme hard disks

M

MisterDeeds

Active Member
Nov 11, 2021
143
33
33
35
Hi all

i have a proxmox server which has 10 nvme hard disks installed. These are displayed correctly in the IPMI.

2.PNG

In Proxmox, however, only the two SATA boot disks are visible

1.PNG

What can I do so that they are displayed?

Thank you and best regards
 

Attachments

  • 1.PNG
    1.PNG
    24.1 KB · Views: 26
Tell me more about your hardware. I have the impression that you still need to configure something since Connected logical drive is empty.
 
sb-jw said:
Tell me more about your hardware. I have the impression that you still need to configure something since Connected logical drive is empty.
Click to expand...
Hi and thank you for the feedback. I have three identical servers, these are the Supermicro Hyper A+ Server AS-2025HS-TNR servers. With all three, the NVMe disks are not recognized in Proxmox, but they are in BMC.
So technically speaking, the disks are present. I also suspect that it is due to a BIOS setting or a driver etc. in Proxmox. However, I have no idea where to start searching...

Code: 
root@ZHTBFPVEV03:~# pveversion -v
proxmox-ve: 8.1.0 (running kernel: 6.5.11-7-pve)
pve-manager: 8.1.4 (running version: 8.1.4/ec5affc9e41f1d79)
proxmox-kernel-helper: 8.1.0
proxmox-kernel-6.5: 6.5.11-7
proxmox-kernel-6.5.11-7-pve-signed: 6.5.11-7
ceph-fuse: 17.2.7-pve1
corosync: 3.1.7-pve3
criu: 3.17.1-2
frr-pythontools: 8.5.2-1+pve1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx8
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.0
libproxmox-backup-qemu0: 1.4.1
libproxmox-rs-perl: 0.3.3
libpve-access-control: 8.0.7
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.1.0
libpve-guest-common-perl: 5.0.6
libpve-http-server-perl: 5.0.5
libpve-network-perl: 0.9.5
libpve-rs-perl: 0.8.7
libpve-storage-perl: 8.0.5
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve4
novnc-pve: 1.4.0-3
proxmox-backup-client: 3.1.2-1
proxmox-backup-file-restore: 3.1.2-1
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.2.2
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.1.3
pve-cluster: 8.0.5
pve-container: 5.0.8
pve-docs: 8.1.3
pve-edk2-firmware: 4.2023.08-3
pve-firewall: 5.0.3
pve-firmware: 3.9-1
pve-ha-manager: 4.0.3
pve-i18n: 3.1.5
pve-qemu-kvm: 8.1.2-6
pve-xtermjs: 5.3.0-3
qemu-server: 8.0.10
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.2-pve1

Code: 
root@ZHTBFPVEV03:~# lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
00:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14ab (rev 01)
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
00:07.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 71)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14ad
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14ae
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14af
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b0
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b1
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b2
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b3
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b4
00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14ad
00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14ae
00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14af
00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b0
00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b1
00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b2
00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b3
00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14b4
01:00.0 VGA compatible controller: NVIDIA Corporation TU102GL [Quadro RTX 6000/8000] (rev a1)
01:00.1 Audio device: NVIDIA Corporation TU102 High Definition Audio Controller (rev a1)
01:00.2 USB controller: NVIDIA Corporation TU102 USB 3.1 Host Controller (rev a1)
01:00.3 Serial bus controller: NVIDIA Corporation TU102 USB Type-C UCSI Controller (rev a1)
02:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
02:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
02:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 14c9 (rev da)
02:00.5 Encryption controller: Advanced Micro Devices, Inc. [AMD] Genoa CCP/PSP 4.0 Device
03:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
03:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
20:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
20:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
20:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
20:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14ab (rev 01)
20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
20:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
21:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for SFP (rev 02)
21:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for SFP (rev 02)
21:00.2 Ethernet controller: Intel Corporation Ethernet Controller E810-C for SFP (rev 02)
21:00.3 Ethernet controller: Intel Corporation Ethernet Controller E810-C for SFP (rev 02)
22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
22:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
40:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14ab (rev 01)
40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
40:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
41:00.0 VGA compatible controller: NVIDIA Corporation TU102GL [Quadro RTX 6000/8000] (rev a1)
41:00.1 Audio device: NVIDIA Corporation TU102 High Definition Audio Controller (rev a1)
41:00.2 USB controller: NVIDIA Corporation TU102 USB 3.1 Host Controller (rev a1)
41:00.3 Serial bus controller: NVIDIA Corporation TU102 USB Type-C UCSI Controller (rev a1)
42:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
42:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
60:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
60:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
60:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
60:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
60:05.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14aa (rev 01)
60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
60:07.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
61:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 06)
62:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 52)
63:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
63:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
63:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 14c9 (rev da)
64:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
64:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
80:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
80:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
80:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
80:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
80:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
80:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
80:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
80:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
80:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
80:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
80:07.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
81:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
81:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
81:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 14c9 (rev da)
81:00.5 Encryption controller: Advanced Micro Devices, Inc. [AMD] Genoa CCP/PSP 4.0 Device
82:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
82:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
a0:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
a0:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
a0:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
a0:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
a0:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14ab (rev 01)
a0:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
a0:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
a0:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
a0:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
a0:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
a0:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
a1:00.0 3D controller: NVIDIA Corporation TU102GL [Quadro RTX 6000/8000] (rev a1)
a2:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
a2:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
c0:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
c0:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
c0:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
c0:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
c0:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14ab (rev 01)
c0:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
c0:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
c0:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
c0:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
c0:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
c0:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
c1:00.0 VGA compatible controller: NVIDIA Corporation TU102GL [Quadro RTX 6000/8000] (rev a1)
c1:00.1 Audio device: NVIDIA Corporation TU102 High Definition Audio Controller (rev a1)
c1:00.2 USB controller: NVIDIA Corporation TU102 USB 3.1 Host Controller (rev a1)
c1:00.3 Serial bus controller: NVIDIA Corporation TU102 USB Type-C UCSI Controller (rev a1)
c2:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
c2:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
e0:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14a4 (rev 01)
e0:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 149e (rev 01)
e0:00.3 Generic system peripheral [0807]: Advanced Micro Devices, Inc. [AMD] Device 14a6
e0:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
e0:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
e0:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
e0:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
e0:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
e0:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 149f (rev 01)
e0:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
e0:07.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14a7 (rev 01)
e1:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 14ac (rev 01)
e1:00.1 System peripheral: Advanced Micro Devices, Inc. [AMD] Device 14dc
e1:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 14c9 (rev da)
e2:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)
e2:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 91)

Best regards
 
Last edited:
Please take a screenshot of the settings under Logical View and Controller View.
 
I think I have found the reason... the backplane has two connector types one for SATA/SAS and one for NVMe, but this one is not connected at all...
1707146889899.png
It's just a bit stupid that supermicro still shows the disks in the BMC even though it can't use them.

Thanks anyway and BR
 
MisterDeeds said:
I think I have found the reason... the backplane has two connector types one for SATA/SAS and one for NVMe, but this one is not connected at all...
View attachment 62607
It's just a bit stupid that supermicro still shows the disks in the BMC even though it can't use them.

Thanks anyway and BR
Click to expand...
Hey @MisterDeeds I am facing the same issue. I connected 4 NVME SSDs onto the backplane but my proxmox server cannot detect them (even though the BMC can see the 4 drives connected).

What exactly is the solution to getting proxmox to detect these drives? (if it's even possible)

Thanks!
 
jdrco said:
Hey @MisterDeeds I am facing the same issue. I connected 4 NVME SSDs onto the backplane but my proxmox server cannot detect them (even though the BMC can see the 4 drives connected).

What exactly is the solution to getting proxmox to detect these drives? (if it's even possible)

Thanks!
Click to expand...
Hi jdrco

In my case, I had to unplug the SAS/SATA connectors (5.) and connect the backplane directly to the NVMe connectors (4.) on the mainboard instead. Each cable then supports 4 NVMe disks. I used the following cables for this:

https://store.supermicro.com/mcio-x8-str-to-str-50cm-30awg-rohs.html
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom