ceph

Hi ! I have a cluster of pve 7.2.7 and ceph 16.2.9 About a month ago, some virtual machines in my cluster with CIS rolled on them (https://github.com/ansible-lockdown/UBUNTU20-CIS ) started to hang up for no reason. Only resetting the machine helps. There is nothing in the logs of the machines...

Hey, we build a new PVE ceph cluster and would now migrate all VMs from our old cluster. In our old one we have ZFS and directory based storage (raw and qcow2 disks) mixed. How can we do this? We already tested "qm remote-migrate" but this seems unable to migrate ZFS to CEPH Storage. Is our only...

First a disclaimer, this is a lab, definitely not a reference design, the point was to do weird things, learn how cephs reacts and then learn how to get myself out of whatever weird scenario I ended up with. I've spent a few days on the forum, seems many of the resolutions were people...

Hi all, We are looking in to deploying a new refurbished NVME HCI Ceph Proxmox cluster. At this point we look at 7 nodes, each with 2 NVME OSD drives, with expansion for 2 NVME OSD's more. As we would quickly saturate a 25GbE link we should be looking in to 40/50/100 GbE links and switches...

I would like to ask a question that I am having. I have the following scenario, 6 HP Proliant DL360/380 G7 servers that I am wanting to create a Proxmox + Ceph cluster. All these servers have the same configurations: 2x Xeon E5630 Quad Core CPU, 48GB RAM, 4x 480GB SSD (connected using LSI SAS...

Hello guys, I updated my PVE Cluster yesterday to the newest Ceph Version and did not notice any issues at first. The VMs and CTs do run normally, I can read and write to the virtual disks, even create new ones, just fine! Migrating between Nodes also works, as well as deleting CTs... But...

Hello, I am a beginner with Proxmox. My ceph storage is full, I have 3 nodes with one OSD each, and the smallest (80GB) is full (more than 90%), each OSD is created from lvm volume and there are hdds, I know that as long as I have a single OSD that is much fuller than the others, it will be the...

Hi all, we are in the process of moving from our old cluster to a new cluster, Due to a high IOWait time on the new cluster, we have decided to enable Ceph caching to help, We are only trialling this at the moment but it does seem to be helping with the try of traffic we are throwing at it...

As the subject states, is there a way to move an existing CEPH cluster to Proxmox? I have an existing cluster of 5 storage OSD nodes, 3 monitors, and a few virtualization hosts that I'd like to convert to proxmox.

Hi guys, as the title suggests I'm trying to get docker volumes to be stored on ceph that is integrated with proxmox. As far as I've seen the proxmox integrations does not have NFS support (correct me if I'm wrong). I'm on ceph pacific moving to quincy and PVE 7.4.3. Is there a supported way to...

Hi! I've got 3 node PVE cluster with CEPH. 1 pool, 4 OSDs per node Yesterday CEPH started rabalancing and it still goes. I think this because I've added abot 6Tb of data and autoscale changed pgs number from 32 to 128. It's ok but I'm bit confused because it's doing recovery fine until 95% is...

As the title would indicate, I am trying to mount my ceph filesystem (quincy) on a VM within the cluster (VE 7.4-3). The ceph filesystem, data pool, metadata pool are all up and running, my monitor nodes are up and happy and ceph health is good. So far, I have - on the nodes: - created a...

I have two PCs, each with 16 GB of RAM and 500 GB of SSD storage. I have created a cluster in Proxmox with them, but when running PowerBI in the first VM of the first node, it does not share the load with the other node. How can I create a high-performance cluster? I am looking to optimize the...

We recently enable kRBD (tick the KRBD box in storage configuration) for our running cluster. Faster IO was the main reason, We record 30% gain in reads/writes in all VM running in writeback cache mode. But then a couple of VMs disks needed to be resized. In both cases disks went to 0 bytes...

Hello Community, Whats the recommended way to create multiple osds per nvme? We wanto make some iops testing with gen4 u.2 nvmes and see if its worth it. "Recommended" in terms of: they should be visible in gui after creation. Thanks Jonas

Hi, Does someone have a few pointers about this setup? I want to install a ha object store and eventually some NFS volumes, using our ceph-installation, to use for our internal k8s cluster. Is it better to get this virtualized to avoid upgrade issues on the physical hosts? Does ceph-dashboard...

Hello guys, we have a PBS running in our Dev-Environment with a Tape-Lib attached, but as I found out, you can only backup to tape if the backups are on a Datastore beforehand... Originally I was planning to backup directly to tape, so I deployed a 1U PBS Server that barely has enough space for...

Hi, we have a Proxmox cluster with CEPH. Can we somehow enable automatic snapshots like with ZFS? https://github.com/zfsonlinux/zfs-auto-snapshot If yes, how does it work?

Hi All I am trying to improve my home LAB and move from local LVM to NFS/ISCSI or one of distributed file system. I have compared GlusterFS, CEPH and other object storage solutions like minio/seaweedfs with NFS/iSCSI and the most appropriate for me seems to be CEPH due to compatibility with...

Hi! I've followed the instructions from https://pve.proxmox.com/wiki/Ceph_Nautilus_to_Octopus Everything went well until the restarting OSD step https://pve.proxmox.com/wiki/Ceph_Nautilus_to_Octopus#Restart_the_OSD_daemon_on_all_nodes The HDD filestore OSDs don't come back online. I've also...