NVME drive not showing up anymore

[spyronia]

Hi,

Since today my NVME drive is not showing up in Proxmox anymore. This happened after I added a NVIDIA Quadro P620, but I'm not sure if this is the cause.

I created a single disk ZFS pool for VM disks and containers, called 'Storage'. Everything worked for a long period of time. Since today I get the error: "could not activate storage 'Storage', zfs error: cannot import 'Storage': no such pool available (500)", and I see a grey questionmark at the storage.

When I enter the BIOS, I can see that the M.2 NVME drive is showing up. In Proxmox I can't find the NVME drive anymore. Underneath I will show commands that were also showing in different threads and more information about my device.

Could anyone please support me?

zfspool: Storage pool Storage content images,rootdir mountpoint /Storage nodes digitus

root@digitus:~# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS sda 8:0 0 111.8G 0 disk ├─sda1 8:1 0 1007K 0 part ├─sda2 8:2 0 1G 0 part └─sda3 8:3 0 110.8G 0 part ├─pve-swap 253:0 0 8G 0 lvm [SWAP] ├─pve-root 253:1 0 37.7G 0 lvm / ├─pve-data_tmeta 253:2 0 1G 0 lvm │ └─pve-data-tpool 253:4 0 49.3G 0 lvm │ ├─pve-data 253:5 0 49.3G 1 lvm │ └─pve-vm--503--disk--0 253:6 0 4M 0 lvm └─pve-data_tdata 253:3 0 49.3G 0 lvm └─pve-data-tpool 253:4 0 49.3G 0 lvm ├─pve-data 253:5 0 49.3G 1 lvm └─pve-vm--503--disk--0 253:6 0 4M 0 lvm sr0 11:0 1 1024M 0 rom

root@digitus:~# lspci -nnk 00:00.0 Host bridge [0600]: Intel Corporation 8th Gen Core Processor Host Bridge/DRAM Registers [8086:3ec2] (rev 07) DeviceName: Onboard - Other Subsystem: Dell 8th Gen Core Processor Host Bridge/DRAM Registers [1028:085a] Kernel driver in use: skl_uncore Kernel modules: ie31200_edac 00:01.0 PCI bridge [0604]: Intel Corporation 6th-10th Gen Core Processor PCIe Controller (x16) [8086:1901] (rev 07) Subsystem: Dell 6th-10th Gen Core Processor PCIe Controller (x16) [1028:085a] Kernel driver in use: pcieport 00:02.0 Display controller [0380]: Intel Corporation CoffeeLake-S GT2 [UHD Graphics 630] [8086:3e92] DeviceName: Onboard - Video Subsystem: Dell CoffeeLake-S GT2 [UHD Graphics 630] [1028:085a] Kernel driver in use: i915 Kernel modules: i915 00:08.0 System peripheral [0880]: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model [8086:1911] DeviceName: Onboard - Other Subsystem: Dell Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model [1028:085a] 00:12.0 Signal processing controller [1180]: Intel Corporation Cannon Lake PCH Thermal Controller [8086:a379] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH Thermal Controller [1028:085a] Kernel driver in use: intel_pch_thermal Kernel modules: intel_pch_thermal 00:14.0 USB controller [0c03]: Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller [8086:a36d] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH USB 3.1 xHCI Host Controller [1028:085a] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 00:14.2 RAM memory [0500]: Intel Corporation Cannon Lake PCH Shared SRAM [8086:a36f] (rev 10) DeviceName: Onboard - Other Subsystem: Intel Corporation Cannon Lake PCH Shared SRAM [8086:7270] 00:15.0 Serial bus controller [0c80]: Intel Corporation Cannon Lake PCH Serial IO I2C Controller #0 [8086:a368] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH Serial IO I2C Controller [1028:085a] Kernel driver in use: intel-lpss Kernel modules: intel_lpss_pci 00:16.0 Communication controller [0780]: Intel Corporation Cannon Lake PCH HECI Controller [8086:a360] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH HECI Controller [1028:085a] Kernel driver in use: mei_me Kernel modules: mei_me 00:16.3 Serial controller [0700]: Intel Corporation Cannon Lake PCH Active Management Technology - SOL [8086:a363] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH Active Management Technology - SOL [1028:085a] Kernel driver in use: serial 00:17.0 RAID bus controller [0104]: Intel Corporation SATA Controller [RAID mode] [8086:2822] (rev 10) DeviceName: Onboard - Other Subsystem: Dell SATA Controller [RAID mode] [1028:085a] Kernel driver in use: ahci Kernel modules: ahci 00:1f.0 ISA bridge [0601]: Intel Corporation Q370 Chipset LPC/eSPI Controller [8086:a306] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Q370 Chipset LPC/eSPI Controller [1028:085a] 00:1f.3 Audio device [0403]: Intel Corporation Cannon Lake PCH cAVS [8086:a348] (rev 10) DeviceName: Onboard - Sound Subsystem: Dell Cannon Lake PCH cAVS [1028:085a] Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel, snd_sof_pci_intel_cnl 00:1f.4 SMBus [0c05]: Intel Corporation Cannon Lake PCH SMBus Controller [8086:a323] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH SMBus Controller [1028:085a] Kernel driver in use: i801_smbus Kernel modules: i2c_i801 00:1f.5 Serial bus controller [0c80]: Intel Corporation Cannon Lake PCH SPI Controller [8086:a324] (rev 10) DeviceName: Onboard - Other Subsystem: Dell Cannon Lake PCH SPI Controller [1028:085a] Kernel driver in use: intel-spi Kernel modules: spi_intel_pci 00:1f.6 Ethernet controller [0200]: Intel Corporation Ethernet Connection (7) I219-LM [8086:15bb] (rev 10) DeviceName: Onboard - Ethernet Subsystem: Dell Ethernet Connection (7) I219-LM [1028:085a] Kernel driver in use: e1000e Kernel modules: e1000e 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP107GL [Quadro P620] [10de:1cb6] (rev a1) Subsystem: Dell GP107GL [Quadro P620] [1028:1264] Kernel driver in use: nouveau Kernel modules: nvidiafb, nouveau 01:00.1 Audio device [0403]: NVIDIA Corporation GP107GL High Definition Audio Controller [10de:0fb9] (rev a1) Subsystem: Dell GP107GL High Definition Audio Controller [1028:1264] Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel


Model: Optiplex 7060
CPU: i7-8700
SATA Operation: AHCI
Secure boot: Disabled
pve-manager/8.0.4/d258a813cfa6b390 (running kernel: 6.2.16-14-pve)

 

[leesteken]

Can you find anything about the NVMe drive in journalctl -b 0 (scroll with the arrow keys)? Looks like the Proxmox Linux kernel does not see the NVMe device (or kicked it from the PCIe bus for some reason).
Maybe the motherboard PCIe layout shares lanes between the PCIe slot for the P620 and the M.2 slot, and only one can be used at a time?
Maybe the M.2 interface connection is poor and the drive cannot negotiate a PCIe gen and speed? Try removing and reconnecting the drive.