nvme

  1. H

    CEPH advise

    I want some advice regarding CEPH. I like to use it in the future when I have a 3 node cluster. The idea is to have 2 NVME ssd's per node. 1 1TB ssd for the OS and 1 4TB ssd for the CEPH storage. Is this a good approach? Btw I'm think of WD SN850X or Samsung 990 Pro SSD's
  2. H

    NVME SSD durability under Proxmox

    Probably asked before but I like to know for a homelab how is the NVME SSD durability under Proxmox. Is it for example wise to separate OS from VM storage because of the writes? So two separate NVME SSD's? I do not run CEPH or ZFS.
  3. L

    CEPH '1 PG inconsistent'

    Hi, I have a 3x node Proxmox cluster running ceph with a mixture of NVMe and SAS hard drives built from some used hardware. I've logged into the dashboard this morning and was greeted with an error in the CEPH dashboard saying 'Possible data damage: 1 pg inconsistent'. I've tried a few things...
  4. C

    Updating Proxmox led to NVMe-Bug

    Hi all, I have a server running on Proxmox, which uses four NVMe-Drives in a ZFS-Raid-Z2. Since I have recently updated my Proxmox, since then I have the Issue that the NVMe-Drives periodically go down, and the VMs running on that datastore are crashing. Typically the Issue occurs during a...
  5. D

    [SOLVED] NVME Drive Disappeared from Host After Thinpool Creation

    I'm learning by doing, so apologies if I've missed some basic steps or information. I have a three node cluster made up of Lenovo ThinkCentres (M900 TFF) that I got from a friend after his work decommissioned them. They've been working great, but only came with 128GB SSD SATA drives, which...
  6. S

    EXT4 I/O Error suddenly

    Hi there, After moving my proxmox server from my parents to my flat I have this new error that stops the server from booting. The boot drive is a nvme ssd. When booting in recovery mode, i can log into the system and do stuff. I tried a rw-test as well as nvme-cli and smartcl with everything...
  7. W

    vfio-pci early bindings for NVMe drive passthrough (TrueNAS VM)

    Hi again, I am still tinkering with the project of a TrueNAS VM on PVE 8.1.4. using a HP DL380 G10 with a PCIe/NVMe/U2 riser card and cage. I already posted here with not much success before getting some more info at the TrueNAS forums over here. It turned out that some people there would...
  8. L

    problems with KINGSTON_SFYRD4000G disks in ceph cluster

    Hello Community. Does anyone have KINGSTON SFYRD 4000G drives in ceph cluster? We have built a cluster on them and are seeing very high latency at low load. There are no network or CPU issues. Ceph version is 17.2.7, cluster is built on LACP inter 25G network cards, Dell R450 servers, 256Gb ram...
  9. D

    PCIe Passthrough NVMe Drive Causes Proxmox to Crash - Using Bifurcation Card

    Hello, I am attempting to pass through 2 NVMe drives to two different VMs. They are on an Asus bifurcation card with a total of 4 m.2 slots, all of which are populated. My BIOS has the PCIe slot set to x4x4x4x4 and all of the drives are seen correctly in Proxmox. Hardware is listed at the...
  10. B

    Proxmox and Storpool

    We have been using Storpool Block Storage to support our public KVM cloud environments and recently have added support for private Proxmox VE clusters utilizing our US based infrastructure as a Service. For us this was an east decision based on our experience with Storpool and the native...
  11. G

    NVME passthrough - Errors

    Hi I have been recently having nvme passthrough problems. I have two samsung 990 in a bifurcation card (asus hyper) These are passed through to one of my virtual machines, but recently I have been getting Unable to change power state from D0 to D3hot, device inaccessible When restarting...
  12. C

    [TUTORIAL] Update Samsung consumer SSD/NVME firmware in Proxmox

    This is a short tutorial how to update the firmware of Samsung's consumer SSD/NVME drives in Proxmox. !! CAUTION !! Upgrading firmwares is always a risk! Before proceeding, make sure - to backup your VMs which are located on the target drive(s) - stop all your VMs/LXCs which are located on...
  13. U

    [SOLVED] Replace Failed Drive in ZFS

    The documentation is clear on the command needed to replace the failed drive after the new one is installed: zpool replace -f <pool> <old-device> <new-device> However, I am unsure of what exact device name to use. The output of zpool list -v and zpool status both show device names that are...
  14. L

    [SOLVED] No boot device found

    Im new to proxmox and have a small HP elitedesk on which i want to install it. It just keeps popping up with no boot device found. I have a samsung 990 pro nvme as only drive since i will be testing on this machine. I disabled secure boot, disabled fast boot, i disabled UEFI (but it didnt see...
  15. T

    TrueNAS Scale VM problems with PCIe NVME passthrough

    I am having problems with my TrueNas VM as the host loses connection when I start the VM with my NVME SSD passed through to the VM. The VM runs fine if I dont passthrough the SSD. IOMMMU is active and no other VMs are running/taking resources. I am very new to working with linux and VMs, so it...
  16. D

    Proxmox ZFS Performance Question - General Structure, PCI Passthrough and NVME SSDs

    I am currently planning to migrate to Proxmox, but would like to find out some important things before I actually take the step. Before I ask my questions, I think it is best to describe my setup/requirements: I don't run many VMs, but a few with high IOPS and consistency requirements, as I run...
  17. A

    2xNVMe datastore not showing anymore

    Hello, I have the following configuration: Lenovo ThinkStation P3 Intel Core i9-13900K 128GB of DDR5 RAM 2 x 250GB Samsung 870 EVO used for Proxmox OS (working fine) 2 x 4TB NVMe Samsung 990 Pro Everthing worked fine since yesterday, when I am not able to see the NVMe datastore. The...
  18. J

    Promox + Ceph: VMs won't start + dreadful performance

    I have been searching far and wide for this. But I can't seem to find a solution. In one of our testing clusters we're experimenting with Ceph. But so far the journey has been bumpy at best. The actual trigger for this post is the fact that one of our VMs locked up and I can't seem to get it to...
  19. P

    Need Help with Proxmox Boot Issue

    Hey everyone, I’m encountering a bit of a snag with my Proxmox setup and could use some guidance. Here’s the situation: I have two NVMe SSDs in my Desktop: one with Proxmox installed and the other with Windows. When I unplug the Proxmox SSD and attach the Windows SSD, everything works fine...
  20. K

    Best way to configure fast NVMe storage to k8s nodes running on ProxMox with backup

    I'm unsure of what is the best way to setup peristant storage for kubernetes via CNI with ProxMox. What I want to do is provision fast NVMe persistant storage to my kubernetes cluster which is running on a single ProxMox node with incremental backups with a Synology DS923+. My goal is to have...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!