Search results

Hello, We are looking for information on how to properly tune CEPH or any other part of the system in order to get the best possible performance on a 4 node CEPH cluster equipped with NVMe disks. We have very poor perfs when using small block size, we have crafted a script in order to...

We have a 4 nodes CEPH cluster that's normally quite stable. In the last three weeks, one of the nodes has failed in an abnormal way (like complete shutdown of the server). Even with console level access to the device, I couldn't do anything on this server and had to power-reset the server to...

Hello, I would like to build a custom LXC container and use it as a template (and be able to use it as any already existing template (like ubuntu 22, or debian…)), we need to add couple of customized settings into this Master template. Then we will use this template to setup customer's...

Handling some complex scenarios and would like to know if It is possible to set a rule that will whitelist internal transfered e-mail based on [internal] DKIM signature. E-mail would be first signed by an internal MTA, before being delivered to PMG, and we would need to: whitelist based on...

We are working on a CEPH setup where we will have 5 nodes spread on 3 locations. One of the location will be there only to act as a "quorum node". We are planning to have AMD based cluster. Can the node acting as the "Quorum node" be Intel based (we are trying to recycle hardware and limit...

Hello, We are working on a configuration where we will have 6 nodes spread on two (very close) sites, all linked on the same LAN (25G). I wanted to know how you would design the solution with CEPH in order to have a working site in case one of the two sites fails ? So idea is to have site A...

After an upgrade of our CEPH cluster (3 nodes) to latest release after the whole process went perfectly "ok", as one of the last actions, I have migrated 15 CT back to their original server… I migrated them using "batch migrate with 4 parallel tasks". Everything on those servers were 100% ok...

DynFi company is a Proxmox-VE partner and also the developer of the DynFi Firewall, a new, modern Open Source Firewall. Since Proxmox-VE and DynFi Firewall are very complementary, we thought that It would be nice to provide end-users with a Screencast detailing the steps required to create a...

I would like to know if you know how I can shutdown ALL VM / CT in parallel ? (as in the GUI). I have setup a script to shutdown VM, CT and then set the noout flag on the CEPH Cluster and finally shutdown the server. Problem is that the script iterates with a for loop (which causes VM to be...

I have noticed these errors on my cluster (on every node for all my osd) : Dec 20 22:00:28 pve1 ceph-osd[3991]: 2021-12-20T22:00:28.350+0100 7fbd20fa4f00 -1 osd.2 1257 mon_cmd_maybe_osd_create fail: 'osd.2 has already bound to class 'nvme', can not reset class to 'ssd'; use 'ceph osd crush...

Hello, I am migrating a big server to a new architecture, transitioning from ZFS based cluster to Ceph cluster. We are using pbs as an intermediary backup / restore stack. server where data / VM to be migrated is located is headless. All VMs have been migrated but one, which remains on the...

Hello, We will migrate a working cluster based on four nodes (ZFS) into a larger cluster with three nodes based on CEPH. We wanted to know if it would be "ok" to join all nodes on a mixed Proxmox cluster with : standalone nodes based on ZFS (Intel) working cluster nodes based on CEPH (AMD)...

I have noticed that the CEPH public / private network weren't properly created during the execution of the Ceph installation wizard. Unfortunately reloading the page killed the process and I can't seem to find a way to relaunch the Ceph installation wizard ? Any idea how I could do that, I'd...

We have been working for long time on the deployment of a cluster based PVE and the new SDN feature. We have had the chance to work with BGP expert and also some of the people involved in the dev. of the project. So this report is a bug report after we moved the cluster to v.7 of Proxmox. We...

I just wanted to make sure that we could have an AMD based PBS in order to bckup an Intel PBS infra ? Thanks

Hello, I am looking for a way to automate the restoration of a snapshoted VM to it's snapshoted initial state. This is a testing environment that we provide to our prospect and I would like to kick back every night at a giveng time to the snapshotted version. Do you know how I can : list...

I have a PBS system where I need to mount a CephFS FS. I have managed to mount this using this command: mount -t ceph 192.168.215.4,192.168.215.3,192.168.215.2,192.168.215.1:/ /mnt/mycephfs -o name=bob,secret=xxxxxxxxxxxxxxxxxxxxxxx== This is working like a charm and I have access to my...

I am pushing my tests with PBS and am now encountering a weird situation. I'll try to describe briefly the situation. I have two pools in my system one for the system and one for the backups / data. root@dc1-pbs01:/mnt/datastore/backup/.chunks# zfs list NAME USED AVAIL...

Just a little question : my PBS is configured using ZFS and compression has been left to default which is "on" and "local" which stands for "lz4". Shall this be left to the default "on" value ? Is there any interest in using compression with PBS (= isn't PBS using it's own compression - in...

We have a large volume that we need to backup which contains 100.000.000 files, with a ∆ / day of about 50.000 files (400GB). For the time being this file system is mounted directly in PBS using fuse kernel driver with mount -t ceph ip.srv.1,ip.srv.2,ip.srv.3,ipsrv.4:/ /mnt/mycephfs -o...