Search results

  1. C

    Ceph Network public and cluster some questions

    Of cause it is easier concerning scalability to use switches in the corosync link. (In all links) But in the end with a mesh network there will be always a scalability problem. If you want to add nodes you will also need a storrage connection.. It is just a question of what you have planned. If...
  2. C

    Ceph Network public and cluster some questions

    Where is the recomandation to seperate ceph cluster and ceph public network? Proxmox says, "as an optional step you can go even further and separate the OSD replication & heartbeat traffic as well. This will relieve the public network and could lead to significant performance improvements...
  3. C

    Ceph Network public and cluster some questions

    This is, what the Wiki says (https://pve.proxmox.com/wiki/Deploy_Hyper-Converged_Ceph_Cluster): Public Network: You should setup a dedicated network for Ceph, this setting is required. Separating your Ceph traffic is highly recommended, because it could lead to troubles with other latency...
  4. C

    Ceph Network public and cluster some questions

    This file is on your local machine, so no one of us can see it.
  5. C

    Ceph network recommendations

    This is the structure proxmox recomands: The most essential part in a Proxmox HA Cluster is the Corosync link. Corosync should have minimum 1 (better 2) seperate physical link (not shared with any other traffic) because of latency. Corosync links do not need a high bandwidth connection, but a...
  6. C

    where to upload files on ceph

    This should describe the way: https://forum.proxmox.com/threads/migrate-a-kvm-image-to-proxmox-ceph.23112/
  7. C

    new cluster, ceph monitor unknown status

    Can you mark this thread as solved, as your problem and the problem of Derelict could be solved with Alwins help?
  8. C

    Proxmox nodes are not showing up status and vote quorum has 2 activity blocked

    Can you check timedatectl status In the shell of all nodes?
  9. C

    Proxmox nodes are not showing up status and vote quorum has 2 activity blocked

    Time syncronization works with ntp https://pve.proxmox.com/wiki/Time_Synchronization Maybe this is helpful,otherwise you should search in the forum concerning time and ntp. Could it be, that the Port 123 is blocked via a firewall?
  10. C

    Proxmox nodes are not showing up status and vote quorum has 2 activity blocked

    Can you please check what your configuration concerning osd_pool_default_min_size and osd_pool_default_size is? You can find this under Node > Ceph > Configuration > and there under [global] I do not really understand why there is a degreded pg, when there is just one osd missing. Normally it...
  11. C

    Proxmox nodes are not showing up status and vote quorum has 2 activity blocked

    There should be one. It is the one which is down and out. Look at the OSD tabs on the nodes. There should be one with the status down and out. You should try to bring it up and in again. Clock skew, as written comes from an problem with the time syncronization. Mayby looking in the forum after...
  12. C

    Best Practice Network

    I do not know, if this is in any relation. Does this happens long time after your problems started, while ceph was recovering? I had written a comment in another thread some days ago, where I found somthing concerning the nf_conntrack: Check nf_conntrack: This connection tracking and limiting...
  13. C

    Proxmox performance

    Do you have access via the GUI to the Tab Shell, or is this resticted?
  14. C

    Proxmox nodes are not showing up status and vote quorum has 2 activity blocked

    You you could try to to restart the proxmox cluster service with systemctl restart corosync node by node starting with that one wich is now seperated. Have you checked that Date and time is synchronized?
  15. C

    Proxmox nodes are not showing up status and vote quorum has 2 activity blocked

    Can you post your network tab of one node? What is in your /etc/pve/corosync.conf? Or posting the output of: cat /etc/pve/corosync.conf and cat /etc/network/interfaces Does ceph report a health warning?
  16. C

    Best Practice Network

    Are this really seperate network cards (6), or cards with more ports? E.g. 3 Network Cards with 2 Ports for the 6 connections? Here you should also mix the connections on different cards. E.g. If you have one network card with 2 Ports linked to 2 switches with lacp (e.g. for storage traffic) you...
  17. C

    Best Practice Network

    Yes, storage frontend and backend from ceph is in this version on one link. Seperation of this two makes sense, but is not as essential as seperating corosync. If ceph starts to rebalance the pg's it might have an impact on performance on the frontend (to the vm's). For this case you can set...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!