Recent content by ghusson

  1. ghusson

    CEPH stretched cluster : PVE partition is not the same as the CEPH partition !

    Indeed. But this situation should not happen. If a node is fenced, having CEPH out of order is OK for me. The problem on the point you mention is that CEPH OSDs didn't start after cluster rejoin.
  2. ghusson

    CEPH stretched cluster : PVE partition is not the same as the CEPH partition !

    And here the case with same cluster partition on the two DCs: ======================================================================== ======================================================================== ======================================================================== RQ : DC1...
  3. ghusson

    CEPH stretched cluster : PVE partition is not the same as the CEPH partition !

    Hello, With Damien BROCHARD (Ozerim), we made some extensive CEPH tests in lab. Our running and functional lab : we configured a simulation of 2 DC cluster, with CEPH stretched cluster mode and a 3rd DC of only one PVE as tie breaker (CEPH) / quorum vote (Corosync) Our test : We cut the link...
  4. ghusson

    CEPH stretched cluster : impossible to add a monitor

    Hello, With Damien BROCHARD (Ozerim), we made some extensive CEPH tests in lab. As I thought we cannot add a new CEPH monitor in proxmox after stretched cluster mode has been enabled : root@training2-vsrv2:~# pveceph mon destroy 400 not enough arguments pveceph mon destroy <monid>...
  5. ghusson

    [SOLVED] Ghost monitor in CEPH cluster

    Hello. Is your CEPH cluster in stretched cluster mode ?
  6. ghusson

    Proxmox cluster duel DC and shared storage

    Best practice is to add a Promxox node which will provide Ceph tie breaker and a Proxmox quorum vote.
  7. ghusson

    Ceph Stretch cluster - Crush rules assistance

    Hello, this question is answered in the documentation. https://docs.ceph.com/en/squid/rados/operations/stretch-mode/ : When stretch mode is enabled, PGs will become active only when they peer across CRUSH datacenter``s (or across whichever CRUSH bucket type was specified), assuming both are...
  8. ghusson

    [SOLVED] sda has a holder...

    What is the output of : hdparm -z /dev/sde
  9. ghusson

    VM unresponsive

    Hello. Journal is managed by systemd. You can use : journalctl -e
  10. ghusson

    Proxmox crashes/best practice for linux bridges

    Too bad. Sorry for you. If you had official support you could have asked a deep problem inspection.
  11. ghusson

    Best practices for 2-server+DAS-setup with Proxmox?

    Yes SLOG (see https://www.truenas.com/blog/o-slog-not-slog-best-configure-zfs-intent-log/) . If you do so, use 2 SSD in mirroring for mitigating hardware failure. Warning, all SSD cannot manage SLOG load. Maybe it is not a good idea in your case. Ok. I am not a ZFS expert, I cannot tell. For...
  12. ghusson

    replication setup advice

    Ok. Maybe it could cut down replication. But pagefile shouldn't be used too much if you system is well dimensioned at RAM level I think.
  13. ghusson

    Proxmox and iSCSI

    Hello. For shared LVM over iSCSI, you can inspire from : https://infohub.delltechnologies.com/en-us/t/dell-powerstore-deploying-proxmox-virtual-environment-white-paper/ For speeding up NFS, be sure to tune network stack (TCP window size if NFS over TCP for example). Some tuning links for...
  14. ghusson

    replication setup advice

    As @Impact said, use "Skip replication". But you should create the disk on the other nodes. Maybe the simpler is to replicate one time and disable replication after. And test, test, test :-)
  15. ghusson

    Proxmox and iSCSI

    "Zfs snapshot from the iscsi" ? What do you mean ?