Recent content by Nemesiz

VNet. Personally I`m not sure but lets try.

Try to enable "VLAN Aware"

Can you show VM network configuration ?

5 MON - A.I suggest to use this number only on really huge setup. 1 MON - on single ceph machine. 2 MON - no quorum 3 MON - regular setup 4 MON - no quorum? Try to lower MON setup to 3.

I suggest you take a look at these links https://www.osris.org/article/2019/03/01/ceph-osd-site-affinity https://ceph.io/en/news/blog/2015/crushmap-example-of-a-hierarchical-cluster-map/

How OSD lose PG objects ? Who cause it ?

In maintenance time I set noout norebalance norecover flags before OSD/server shutdown. It stops from moving data around others OSD. In some Ceph talks was mentioned that single HDD can impact all cluster event HDD SMART will not show any evidence of coming HDD death. So you must track of disk...

Proxmox installation is not so rich with option. Try to install debian as you wish and then convert to Proxmox.

Hi, have you tried to run 'zpool import -d /dev/disk/by-id' to see what zfs sees ?

You have to ask what Ceph will solve for you. Scalable, failure .... If you decide to use Ceph in my short experience and other people suggestions: 1. Get fast network as possible. Network latency have big role. 2. Get SSD/NVME enterprise grade to survive the load. 3. More CPU cores not always...

What you need to do is to create missing config files. To get all keys use this: # ceph -n mon. --keyring /var/lib/ceph/mon/ceph-pvecloud01/keyring auth ls 1. Create /etc/pve/ceph.conf and put needed info 2. Link the file: # ln -s /etc/ceph/ceph.conf /etc/pve/ceph.conf 3. Restore keyrings...

Does it give good result? # ceph -n mon. --keyring /var/lib/ceph/mon/ceph-pvecloud01/keyring -s

Go to store.db You will find .sst file. Copy it to your PC. Open with Notepad++ or other editor and search for "key =" It should be your admin key

Is your /var/lib/ceph/mon/* empty ?

If your OSD is still running / or not umounted then you can get Ceph cluster ID from /var/lib/ceph/osd/ceph-X/ceph_fsid