Search results

  1. M

    Reduced data availability: 40 pgs inactive, 42 pgs incomplete

    In a 5 node cluster, I had to replace some failed SSD's and now the CEPH cluster is stuck with "Reduced data availability: 40 pgs inactive, 42 pgs incomplete" Reduced data availability: 40 pgs inactive, 42 pgs incomplete pg 2.57 is incomplete, acting [1,35,14] (reducing pool CephFS_data...
  2. M

    shared WAL between CEPH OSD's?

    Is it possible to share a CEPH WAL between all the OSD's, instead of having to partition the WAL? If I have 12 drives, I have to create 12 equal partition on the WAL, and assign each partition to an OSD. Is there a better way to assign the WAL?
  3. M

    1 node offline after changing host hardware

    I have a 3 host cluster and changed one of the hardware nodes. The new machine didn't want to boot from the proxmox OS drive, so I decided to Install Proxmox onto another drive. Before I did this, however, I removed the 3rd node (SRV3) from the cluster. Then i wanted to re-add the node, but...
  4. M

    ZFS multi node cluster?

    Is it possible to setup a ZFS multi node cluster, like one would do with CEPH? Let's say I have 20x servers, each with 24 SSD's, and I want to use ZFS on each server. Can I have replicated storage across the cluster, so that in the event that a node fails, or I need to move some VM's off one...
  5. M

    Could not connect to ceph cluster despite configured monitors (500)

    Please help. I tried to change my CEPH IP's from 192.168.10.0/24 to 192.168.11.0/24, but it wen't horribly wrong. My initital setup is / was as follows: 3 servers: SRV1 - 192.168.10.241 SRV2 - 192.168.10.242 SRV3 - 192.168.10.243 I wanted to move CEPH to a 2nd IP subnet, with different network...
  6. M

    how to identify OSD / physical drive

    How do I see which /dev/sdx an OSD is running on? I need to remove some drives from my cluster, but don't know which OSD to stop and remove, to remove /dev/sdh (for example).
  7. M

    how to change CEPH OSD logical sector size?

    Hi, Does anyone know how to change the Logical Sector size of a CEPH OSD? I have searched the forums but cannot find a solution.
  8. M

    how to rename a ceph OSD?

    Hi, Is it possible to rename a CEPH OSD? ^Croot@virt3:~# ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 87.33948 root default -3 29.11316 host virt1 1 hdd 7.27829 osd.1 up 1.00000 1.00000 2 hdd 7.27829 osd.2 up...
  9. M

    how to improve performance?

    Hi, We have a 3 node cluster with CEPH, using the following hardware: 3x Supermicro server with following features per server: 128GB RAM 3x 8TB SATA HDD 2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710) 2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz Quad port 10Gbe Inter NIC 2x...
  10. M

    cannot stop ceph OSD from command line

    Hi, I am trying to stop a CEPH OSD from the command line but it doesn't want to stop: root@virt2:~# ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 65.50461 root default -3 21.83487 host virt1 0 hdd 7.27829 osd.0 up 1.00000 1.00000...
  11. M

    How to pin CPU cores to ceph OSD?

    Hi, How do I pin a CPU core to a CEPH OSD?
  12. M

    how to resize CEPH journal?

    I see the CEPH journal is 1GB. What is the correct procedure to make it bigger? Do I purely delete the 1G partition in fdisk, create a new one, and then specify what type? Or is there a preferred way to do it?
  13. M

    KVM guest installation is a bit slow, how to improve?

    Hi, I wonder if someone can shed some light on this matter. The environment: 3x Supermicro server with following features per server: 128GB RAM 3x 8TB SATA HDD 2x SSD drives (intel_ssdsc2ba400g4 - 400GB DC S3710) 2x 12 core CPU (Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz Quad port 10Gbe Inter...
  14. M

    Which NVME's are compatible?

    Hi, I am considering adding some NVME devices to a new installation of Proxmox, but cannot really see on the forums which devices are compatible, or even which are incompatible. Does anyone know where I can find a list of compatible and working NVME's? I want to use an NVME as ZFS or even LVM...
  15. M

    3 node cluster setup recommendations

    Hi, I have read just about every post on this forum on this topic. Some have some useful information, but I can't get all the answers that I have questions for, hence this post. I need to setup a 3 node high available cluster to host 14 virtual machines, Linux and Windows based. This is to...
  16. M

    10Gbe high availability without switches?

    Hi I wonder if this is at all possible: If I setup a 3 node CEPH or GlusterFS cluster and I want to dedicated a 4port 10Gbe NIC in each server for storage network. Can I set it up in such a way that I don't need a switch, but still achieve high availability? i.e. run cables from: From...
  17. M

    3/4 node setup high availability best practice?

    Hi all, I'm new to Proxmox, though not new to Linux or virtualization. Can someone please tell me (I couldn't get a definite answer while searching through the forums) What is the best configuration for Proxmox on 3 or 4 nodes? I need to virtualize about 12x physical servers and will be...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!