Search results

Hello! I have a 10 nodes hyperconverged cluster. Each node has 4 OSDs (total 40 OSDs). I have 2 different questions: QUESTION 1 - OSD REPLACEMENT (with identical SSD) Since I need to replace an SSD (one OSD has crashed 3 times in latest months so I prefer to replace it with a brand new one)...

Hi, I have a growing Linux Debian 9 VM that I need to expand to 3 TB. I've expanded it from Proxmox interface and it correctly reports 3 TB size. But I'm unable to grow the partition over 2 TB because the virtual disk has a MBR. The VM is mission critical so I must carefully plan the operation...

Hi! Last night we upgraded our production 9-nodes cluster from PVE 5.4 to PVE 6.4 and from Ceph 12 to 14 and then to 15 (Octopus), following the official tutorials. Everything went smoothly and all running VMs have been online during the upgrade, so we're very happy about the operation. Now the...

Hi! I'm comparing 2 switches with 10 Gb/s ports, tu build a small 3-nodes cluster with with PVE+Ceph. Ceph will run on NVMe drives. One switch has a latency of 2.8 microseconds at 10 Gb/s, while the other (which is cheaper) has 4.8 microseconds at 10 Gb/s. Does this difference matters at all...

Hi! I have a big LXC container (2 TB) running on a Proxmox VE 5.4 with Ceph Luminous storage. The container is running mission critical services and cannot be stopped. Two days ago I took a snapshot from the Proxmox interface (you can see it named "pre_upgrade_tls" in the screenshot below). Now...

Hi! Our little hyperconverged cluster was born 2 years ago with 3 nodes and 12 OSDs in total. Nodes have triplicated since then and now the cluster has 10 nodes and 40 OSDs in total: 512 PGs are not enough anymore (we have to rebalance often, for example) and we'd like to increase the PG count...

Hello! Some days ago I had a node of our production Proxmox VE 5.4-13 7-nodes cluster allocating much more RAM than the sum of the RAM limits configured for the VMs running on it. Using top command I found out that the KVM process of a VM having a limit of 4 GB was allocating 60 GB!!! I'd...

Hi! I have a 7 node production cluster with HA and Ceph storage. Every node is running Proxmox 5.4. I recently found out that firewall is not working at all (it was working when we last checked, some months ago): every port of every VM is opened even though per policy should be closed! It seems...

Hi! We have a 5 node Proxmox+Ceph cluster (we use the same nodes for computing and distributed storage). We have LZ4 compression enabled, which works pretty good (we're saving more than 16%). My ceph df detail looks like this: As you can see, I have 15 TB of physical storage (each of the 5...

As the title suggests...I've taken a snapshot of a running KVM machine (including RAM) on my Ceph cluster. It worked, but now I'd like to know how much space it's taking on ceph cluster and if this space will remain the same forever or will grow in the future. Thank you very much!

Hello! I'm setting up a NVMe-only Proxmox/Ceph infrastructure. I've just heard about Intel SPDK, which seems to speed a lot Ceph transactions when using fast NVMe drives vs Linux kernel default implementation: https://www.slideshare.net/mobile/DanielleWomboldt/ceph-day-beijing-spdk-for-ceph On...

Hi! Thanks to a discussion on another thread today I digged into the Ceph Luminous changelogs. If I understood correctly (please correct me if I'm wrong or if this is not applicable to pveceph) Ceph 12 will have the new storage engine called Bluestore enabled by default instead of XFS and writes...

Hello! I'm planning to build a new 3-node production cluster based on Proxmox VE 5.0 (as soon as the stable will be released) with Ceph storage running on the same nodes, as described in the tutorial. The 3 nodes will be identical and will have a 10 Gb internal network (for Ceph and corosync) in...

Hi! I have Proxmox VE 3.4-3 with kernel 2.6.32-37-pve. My server runs several OpenVZ containers together with KVM virtual machines. At the moment cat /sys/kernel/mm/ksm/pages_sharing returns 0 and that's fine because my RAM usage is under 80% and KSM_THRES_COEF=20 in /etc/ksmtuned.conf. My...

Hi! I have 2 Proxmox VE 3.4 nodes with ZFS local storage mirrored through DRBD (Primary/Primary with 2 volumes) to guarantee complete redundancy. The nodes are linked with a dedicated 10Gbps on SFP+ and DRBD version is 8.3.13 (the version coming with Proxmox VE 3.4). Since I'm experiencing...

Hello, I have one of my OpenVZ guests eating my I/O and slowing down all the others VPS when a particular process runs. I just saw that OpenVZ recently added I/O limits: https://openvz.org/I/O_limits Proxmox VE 3.4 seems to satisfy the kernel requirement (greater than 2.6.32-042), while vzctl...

Hello! I'm getting random freezes (every some hours) of a system running latest Proxmox VE 3.3 with kernel 2.6.32-34-pve. Just before the freeze, this is logged into the syslog. Do you have any idea? I tested the memory with MemTest86 for hours: 100% sane. Thank you very much! Dec 12 19:58:53...

Hello, I'm trying to mount a NFS share asynchronously and without remote locks. I added 2 options to my storage.cfg, changing options vers=3 to options vers=3,async,nolock Then I rebooted and run a cat /proc/mounts: 10.0.0.252:/proxmox /mnt/pve/proxmox nfs...

Hi all! First of all, congratulations to the developers of this AWESOME virtualization platform! Second, I have an idea to suggest to the developers: at the moment the Proxmox GUI shows just the "used memory" of a VPS, which includes memory used by the programs + buffers + cache. I think that...

Ignore me, false alert [NOTE: The following is a false alert, so don't care about it...It was an error of OpenVas obviously....I'm sorry!] Hi All, I set up a Proxmox VE 1.8 environment, all default, with Shorewall firewall configured. Then I updated it all (apt-get update and apt-get upgrade)...