ceph cluster

Building a small home lab HA Proxmox/Ceph cluster with 3 Dell 210ii boxes. I'm trying to do it on the cheap and have decided to forego a 10Gb ring in favor of LACP'd 1Gb based network with quad port intel cards in each of the three boxes and an HP 1810G-24 switch. Due to ignorance I was...

Hi guys I have a weird situtation tought you could help me I have a cluster of three nodes running proxmox + ceph. Ive installed the os (+ceph) on 2 x usb drive as zfs raid1, now I have high I/O wait on the CPU because the usbs are slow. I added 2 x SAS 15K and I’m thinking if its possible to...

Hi all, I have a 3 nodes cluster with a ceph storage (3mon, 3 OSD and a CephFS installed). I enabled the High Availability feature for my virtual machine and when I shutdown one of the nodes, my VM migrates to another and restarts. My VM is a Windows 2012 R2 server. My question is : is there a...

Hello, I've got the following errors on my ceph cluster : 2018-12-14 17:34:07.109670 osd.3 osd.3 192.168.99.5:6804/663740 39 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2018-12-14 17:34:07.113561 osd.7 osd.7 192.168.99.5:6800/663643 19 : cluster [WRN] Monitor daemon...

Hi, I've tried to get Ceph working on my proxmox cluster, but it failed. Many OSD haven't been created and actually I can't destroy existing pool and/or add OSD. I wass wondering if there is a way to fully reinit ceph without reinstall proxmox I have a 4 nodes cluster running Ceph 5.2.9...

I have a hyperconverged proxmox/ceph cluster of 5 nodes running the latest proxmox/ceph (bluestore) with 6 480GB SSD's each (totalling 30 OSD's) and I'm starting to run slow on storage. Is it possible and would it be wise to replace some (if not all) SSD's with bigger ones? Or if I added a node...

I am making a cluster among three PVE servers, the 1st server has ( 8 x 1TB disks) , the 2nd and the 3rd servers have ( 24 x 1.2 TB disks ) I finished all the required configurations for clustering and ceph, but I dont know what is the optimal configuration for my pool to be able to survive the...

Hi, I follow instructions here: https://pve.proxmox.com/wiki/Ceph_Jewel_to_Luminous but Im no able to continue just right in first step. When I enter: `ceph osd set sortbitwise` I got error: `Error initializing cluster client: Error` What is wrong and how can I solve it? Thanks

Hi, in the wiki you provide this recommendation: "We install Proxmox VE on a fast and reliable enterprise class SSD, so we can use all bays for OSD (Object Storage Devices) data." Unfortunately there's not more information for this architectural design. Could you please explain why the OS...

Hello, I just want to create brand new proxmox cluster. On some older cluster I used glusterfs, now I have some time and I try to compare glusterfs vs new ceph (PVE 5.2). on my lab I have 3 VM (in nested env) with ssd storage. iperf show between 6 to 11 gbps, latency is about 0.1ms I make one...

After creating ceph-pool, I created a test vm in disk image RBD group. However, I was surprised to see the VHD was also showing in container KRBD group. Is it normal? Pardon me as I am a newbie to PROXMOX-CEPH. Currently I have a two nodes cluster but will add one more node soon. Total number of...

Hi, I would like build a 4 nodes cluster system with shared filesystem using ceph. All nodes are the same. 48 core Intel CPU, 2x 100GB SFP network, 4x 1T normal disk, 256GB memory I don't need high IO speed, but the stable state is important. I going to create a raid5 storage from the 4 disk...

How to create CEPH storage in proxmox for ISO and templates?

Hi, I'm after a little help with Ceph pools as I can't fully understand the calculator. I have four nodes, each node has x6 500Gb drives which are my OSD's. I'm looking to be able to sustain two nodes failing. What would be the recommended pool size & pg num? Regards, James

Hello, I have a 3-node ceph cluster and Create OSD Follow this. 1. SSD 3-6 (/dev/sdc-sdh) is ok usable 2. But SSD 1-2 (/dev/sda-sdb) Tab OSD >> is Not applicable and not show osd.xx 3. And SSD 1-2 (/dev/sda-sdb) Tab Disk >> show type usage "parititions" 4. I Delete parititions on SSD...

That does not make any difference unfortunalty.... @fresh installed proxmox 5.0 when using: https://pve.proxmox.com/wiki/Ceph_Server cat /etc/*release PRETTY_NAME="Debian GNU/Linux 9 (stretch)" NAME="Debian GNU/Linux" VERSION_ID="9" VERSION="9 (stretch)" ID=debian [..] pveversion -v...

Got an older 7x node 3.4 testlab (running Ceph Hammer 0.94.9 on 4x of the nodes and only VMs on 3x nodes), which we wanted to patch up today, but after rebooting our OSD won't start, seems ceph can't connect to ceph cluster. Wondering why that might be? Previous version before patching...

Hi Folks, I'm in need of a hypervisor cluster. I've been thinking about using proxmox and ceph for it instead of vmware. I like opensource tech etc. I was thinking of upgrading when new versions of proxmox and ceph come out. The logical way I think would be move the VMs to the two other nodes...

Hi, My issue is very strange.. I have one cluster of 3 physical servers where is installed Proxmox VE 4.4. I installed on each nodes ceph with 'pveceph install -version hammer' command. I have 3 monitors on the different nodes in my cluster. Each servers have 1 disk of 1TB and an other where...

Hello, i have a Ceph node with this ram allocation: root@nodo3:~# free total used free shared buffers cached Mem: 65939008 65211332 727676 2584660 724684 54518756 -/+ buffers/cache: 9967892 55971116 Swap: 3801084 3801072...