Recent content by Drkrieger

Hello folks! I've been working on a Ceph cluster for a few months now, and finally getting it to a point where we can put it into production. We're looking at possibly using an all flash storage system and I'd like to play around with using the inline compression feature with Bluestore. Now...

Thanks for the info Guletz, but we'll be running pretty much our entire company within this cluster so it will be hard to duplicate every service with redundancies without bloating the cost due to licensing. So in our Proxmox cluster we will have our Active Directory DC's (Windows at the...

Thank you for the info, I appreciate the quick response. The company I work for is interested in purchasing Proxmox, however they're going to want the COLO/Fault Tolerance feature. Is this something that will be brought to Proxmox in the near future? Or is there a way to do this currently in...

Hello! He have a Proxmox VE 5.2 cluster consisting of 4 nodes, each running on a Supermicro server. We've created the cluster, and created an HA group, then added VMs to the group. We've then spread the VMs out over the 4 machines, and tested a node failure (pulled the power). When the node...

This step is done after setting up the bcache and attaching the cache device, run this command: echo 0 > /sys/block/bcache<number of bcache device>/bcache/sequential_cuttoff If you have several bcache devices, you can do them all at the same time like this: for f in /sys/block/bcache?/bcache...

A comparison of without bcache to with: No bcache, w/100GB NVMe Journal: With 200GB bcache, 20GB NVMe Journal: Higher block size on the VM drives will net much higher sequential write performance (I was seeing numbers over 400MB/s with 16K sectors).

FYI, I got the bcache working. Significant improvements in overall cluster write performance (more than double in my VM's CrystalDiskMark bechmarks). Reads were pretty much unaffected. And the load on the nodes is minimal still. The highest CPU usage I've seen is just over 20% on all nodes with...

@David Herselman , just curious if you see a major performance increase using bcache versus not. I'm in the process right now of building a PoC for our company, just a small cluster of 3 nodes but in production will be 5. I'm seeing 'slow requests blocked' errors every now and then when running...

Hello! I'm in the process of testing a PoC before deploying it into our production environment. I've been comparing between Bluestore and Filestore, both with SSD Journals (using Enterprise NVMe+4TB consumer spinners), and I'm finding that Filestore gives better overall performance (even with...

Nevermind, I found the solution. For those of you that break things like me, the solution is to edit the '/etc/pve/ceph.conf' and clear out the lines that are used by the original monitor. As soon as this is done, you can create the monitor without issue.

Hello! I'm in the process of testing out a small 3 node Proxmox/Ceph cluster, and in my failure/fault testing I've run into an issue rebuilding a node. I've gotten the node to join the Proxmox cluster just fine, however the monitor node still existed in the Ceph cluster. When I removed the...

Disregard, issue resolved. Found the IOMMU and SVM Modes in the bios, hidden under the 'overclock' menu. Enabled them and now it's working fine. That's MSI for you...

Hello! I'm trying to test an external Ceph cluster to use as a redundant storage backend for my Proxmox setup, but I can't seem to get the compute head to fire up any VM. I get the following error when trying to start any VM: Virtual Environment 5.2-5 Virtual Machine 100 (Test-Winbox) on node...