ceph

Hello guys, I updated my PVE Cluster yesterday to the newest Ceph Version and did not notice any issues at first. The VMs and CTs do run normally, I can read and write to the virtual disks, even create new ones, just fine! Migrating between Nodes also works, as well as deleting CTs... But...

Hello, I am a beginner with Proxmox. My ceph storage is full, I have 3 nodes with one OSD each, and the smallest (80GB) is full (more than 90%), each OSD is created from lvm volume and there are hdds, I know that as long as I have a single OSD that is much fuller than the others, it will be the...

Hi all, we are in the process of moving from our old cluster to a new cluster, Due to a high IOWait time on the new cluster, we have decided to enable Ceph caching to help, We are only trialling this at the moment but it does seem to be helping with the try of traffic we are throwing at it...

As the subject states, is there a way to move an existing CEPH cluster to Proxmox? I have an existing cluster of 5 storage OSD nodes, 3 monitors, and a few virtualization hosts that I'd like to convert to proxmox.

Hi guys, as the title suggests I'm trying to get docker volumes to be stored on ceph that is integrated with proxmox. As far as I've seen the proxmox integrations does not have NFS support (correct me if I'm wrong). I'm on ceph pacific moving to quincy and PVE 7.4.3. Is there a supported way to...

Hi! I've got 3 node PVE cluster with CEPH. 1 pool, 4 OSDs per node Yesterday CEPH started rabalancing and it still goes. I think this because I've added abot 6Tb of data and autoscale changed pgs number from 32 to 128. It's ok but I'm bit confused because it's doing recovery fine until 95% is...

As the title would indicate, I am trying to mount my ceph filesystem (quincy) on a VM within the cluster (VE 7.4-3). The ceph filesystem, data pool, metadata pool are all up and running, my monitor nodes are up and happy and ceph health is good. So far, I have - on the nodes: - created a...

I have two PCs, each with 16 GB of RAM and 500 GB of SSD storage. I have created a cluster in Proxmox with them, but when running PowerBI in the first VM of the first node, it does not share the load with the other node. How can I create a high-performance cluster? I am looking to optimize the...

We recently enable kRBD (tick the KRBD box in storage configuration) for our running cluster. Faster IO was the main reason, We record 30% gain in reads/writes in all VM running in writeback cache mode. But then a couple of VMs disks needed to be resized. In both cases disks went to 0 bytes...

Hello Community, Whats the recommended way to create multiple osds per nvme? We wanto make some iops testing with gen4 u.2 nvmes and see if its worth it. "Recommended" in terms of: they should be visible in gui after creation. Thanks Jonas

Hi, Does someone have a few pointers about this setup? I want to install a ha object store and eventually some NFS volumes, using our ceph-installation, to use for our internal k8s cluster. Is it better to get this virtualized to avoid upgrade issues on the physical hosts? Does ceph-dashboard...

Hello guys, we have a PBS running in our Dev-Environment with a Tape-Lib attached, but as I found out, you can only backup to tape if the backups are on a Datastore beforehand... Originally I was planning to backup directly to tape, so I deployed a 1U PBS Server that barely has enough space for...

Hi, we have a Proxmox cluster with CEPH. Can we somehow enable automatic snapshots like with ZFS? https://github.com/zfsonlinux/zfs-auto-snapshot If yes, how does it work?

Hi All I am trying to improve my home LAB and move from local LVM to NFS/ISCSI or one of distributed file system. I have compared GlusterFS, CEPH and other object storage solutions like minio/seaweedfs with NFS/iSCSI and the most appropriate for me seems to be CEPH due to compatibility with...

Hi! I've followed the instructions from https://pve.proxmox.com/wiki/Ceph_Nautilus_to_Octopus Everything went well until the restarting OSD step https://pve.proxmox.com/wiki/Ceph_Nautilus_to_Octopus#Restart_the_OSD_daemon_on_all_nodes The HDD filestore OSDs don't come back online. I've also...

I'm planning a 7nodes proxmox cluster. Of those 7nodes, 3 will have a ceph shared storage. Each node is equipped with 3x RJ45 and 2x SFP+ network interfaces. I know that is best to have separated networks for CEPH, PROXMOX CLUSTER and LAN, but I was thinking if is a good Idea to use a setup with...

So currently I have 3 nodes, 3x16x18TB HDDs, in a Ceph cluster running normally. Today i went to go add 2 more nodes with 2x12x12TB drives. All was fine untill I went to go add the OSDs into ceph. I set the NoRecover flag but forgot to set the Noout and the Norebalance flag. The cluster failed...

When I add a 3rd monitor to CEPH the 3rd node times out and gives me timeout error 500 on the crush map and database. Also navigating to any of the ceph tabs on the 3rd node shows no data. However ceph continues to work. I’m not in front of the cluster at the moment but when I am tomorrow, I...

Hi, I have a ceph cluster with 6 nodes, and 3 nodes has mgr installed, and one (Proxmox2) is active and 2 are standby. I had an active zabbix agent installed on proxmox2, so it will send ceph info to zabbix server and it is working fine. But, every time when I have problem with proxmox2, ceph...

Hi All I am working on a proof of concept for a micro hosting requirement. The client requires hosting of many small VM's, about 30-50 of 2GB of RAM each and 30GB of storage each. CPU and disk Load generated by these VM's are very low. They are looking to retire their two old Dell R540...