Search results

So, I have a 14 node cluster. We had a switch failure and we had to move all the frontend networking (public and pve cluster) endpoints to a backup switch and after a couple of days, we moved them back. Now, one node from the cluster misbehaves, I can't write to /etc/pve folder. I've...

Hi, I have a three node cluster, each node has 35 OSD + 1 SSD as bluestore db. replica 2, failover host. The cluster is used for cold-storage - and i'm starting to dump data on it. I know that my bottleneck is the single SSD on each node - all the incoming traffic will hit it. Now, my...

Hi, I have a Proxmox Cluster , 14 nodes - with Ceph. Is it possible to add additional Ceph members (with PVE installed) that are not members of the clusters ? I wonder real life setups of large clusters - if there are any issues/

Hi, Fresh install debian+pve from wiki ubuntu 22.04 downloaded from the templates page. lxc-start -n 100 --logfile x.x --logpriority=DEBUG --foreground cat x.x INFO confile - ../src/lxc/confile.c:set_config_idmaps:2267 - Read uid map: type u nsid 0 hostid 100000 range 65536 INFO...

Hi, I have a few nodes on a cluster with latest pve - running k8s in kvm's with Centos7 When running high cpu tasks, the node freezes without errors, only a hard reboot resolves this. Hardware is different - so the same behavior on different hw hosts. I've downgraded the kernel to 5.11.22-7...

Hi, I use HDD for ceph OSD and nvme partitioned for bluestore db/wal I have a disk that won't come up, i've done a destroy (with cleanup option) task so I can add it again however the bluestore partition didn't get cleaned and I can't find it example server 12 disks, 2 nvme's disks 1-6 uses...

Hi, While copying data to a cephfs mounted folder , I encounter tons of messages like this: [52122.119364] libceph: osd34 (1)10.0.40.95:6881 bad crc/signature [52122.119599] libceph: osd9 (1)10.0.40.98:6801 bad crc/signature [52122.119722] libceph: read_partial_message 00000000a1a2de9f...

Hi, I have a ceph cluster configured via proxmox and added object storage via radosgw package. My cluster is unstable for the moment and I have random reboots - something that I'm investigating now. My issue is that after some nodes are rebooted, the /etc/ceph/ceph.conf file is overwrited...

Hi, Since proxmox uses a custom setup for installing and managing ceph, does it work to do other tasks with cephadm ? I see in the dashboard that many features are unavailable due to a missing "orchestrator" and the choice is rook (k8s) or cephadm. I haven't tried to install it - afraid of...

Hi, I've tried to add a new node to my cluster and it failed - and now the cluster config buttons are greyed: Node pvedell6 was supposed to join the cluster - and it's pve interface its not reachable (if I try to access it directly) Rebooted, nothing. root@pvedell1:~# pvecm status...

Hi, I could not find any docs about this - maybe it's not possible but here's the situation: - Openstack (Rocky) cluster behaving weirdly - so I decided to try to move the vm's to proxmox - copied the volume to pve, raw. No boot. Convert it to qcow, no boot. - I'm able to mount the disk on...

So I have a small cluster with ceph installed, all nice and dandy. I've configured a couple of weeks ago a few other PVE's to use that Ceph cluster... but now I want to add new servers and nothing happens. I've read the docs and from other blog posts and i'm stuck. Steps done on working and...

Hi, I have added a remote rbd pool (ceph cluster) to a proxmox machine that is not in that cluster. (added via GUI and copy the keyring in /etc/pve/priv/ceph/xxxx.keyring) Things I noticed: - after the RBD pool is added, I need to restart pvestatd.service so that the GUI shows the pool...

Hi, I'm scratching my head here with the following storage setup - I have 6 x 2TB nvme and I need to "provide" maximum storage with some redundancy. Let's say that IOPS is not that important and the fact the in theory the nvme's (INTEL SSDPE2KX020T8) are fast enough for my needs (LXC ->...

Hi, I have the following setup: 4 x Dell R740xD 512G RAM 6x10TB SATA 2x10G bond to Mikrotik CSR3xx (20G bonds) - for Storage Network 2x1G bond for VM's to a Juniper Switch Ceph configuration is as it comes by default: [global] auth_client_required = cephx...

Hi, I'm looking for a solution to have the KVM / LXC VM encrypted so the PVE Admin can't access data inside. Something that the customer can access his environment via SSH / Web but without a proper authorization the disk or environment to be unusable for a foreign eye. Any ideas are welcomed.

Hi, I have a external (same rack) Ceph cluster used by Openstack and I want to share its resources with Proxmox. I've followed the instructions from here: https://x.x.x.x:8006/pve-docs/chapter-pvesm.html#storage_cephfs Then from Datacenter->Storage-> Add CephFS I see that there are options...

Hi, I'm a seasoned proxmox admin and unfortunately i've hit a brick wall with a basic config that I have successfully working in 8 servers and in this one, no luck: auto lo iface lo inet loopback iface lo inet6 loopback auto enp8s0 iface enp8s0 inet manual up route add -net 1.2.3.128...

Hi, I'm working on a PoC to make a HDFS cluster with LXC and I have a couple of JBOD's mounted in debian with pve : /dev/sdc1 3.6T 89M 3.4T 1% /mnt/data1 /dev/sdd1 3.6T 89M 3.4T 1% /mnt/data2 /dev/sde1 3.6T 89M...

I have the following setup, independent machines: pve1 - proxmox v4.0 pve2 - proxmox v4.1.1 pve3 - proxmox v5.0 I want to make a new cluster with v6 and so far I did: 1. migrate all vm's from pve1 to pve3 [done] 2. reinstalled pve1 with v6 [done] 3. started migration of all vm's from pve2 to...