Search results

  1. B

    Is anybody doing HA between two geographical locations ?

    I wonder if it is possible with Proxmox to do the HA that way with Storage Replication across nodes in two different data centers. Any tried that ? Any other ideas ? We can get a fast and reliable link between data centers from the same data center provider. thank you
  2. B

    how to test rbd storage from client host ?

    I have an rbd storage, I can do rados bench from the ceph cluster but how would I go about testing from the client proxmox cluster ? When I try to run rados bench on the client with rbd storage I get "no monitors specified to connect to" Any help with this command appreciated. Thx
  3. B

    Best way to test Ceph

    Thank you - this seems to be exactly what I was looking for, I will give it a read...
  4. B

    Best way to test Ceph

    I have a new 3 node dedicated ceph cluster on pve5.1. I am connecting to 4 node PVE5.1 cluster with VMs over ceph public 10GB network with 2 bonded interfaces and 9000MTU size enables for private and public ceph networks. I have 18 x same 1TB drives, 10K spinners which gives me 18 OSDs. My 4...
  5. B

    zfs pool

    ok I was just able to edit the storage.conf and restart pve daemon - that did the trick. I see now local zfs pool on each node. Still wondering if there is a bug in the GUI that I was not able to see second node's pool and be able to add it.
  6. B

    zfs pool

    I understand it is a local storage. I am just adding the storage to the cluster a local storage within that particular node just like I would be adding LVM or directory but of type zfs and I don't see the second pool for the second node. What am I doing wrong ?
  7. B

    zfs pool

    I am refering to addtional storage, I have pve installed on a raid controller drive and have lvm there. I added additional hard drives to this machine and added two pools via cli: on PVE01: zpool create -f -o ashift=12 zfspoolpve01 mirror sda sdb ...and on PVE02: zpool create -f -o ashift=12...
  8. B

    NUMA question

    Thank you I am not sure if I understand. I thought that numa had 2 main objectives in multi socket hyper-visor: 1 allocate the logical cores for a VM within the same CPU socket and 2 allocate memory for a logical core within the same CPU socket ...so there is no penalty when processing. So...
  9. B

    zfs pool

    I have a two node test cluster with expected 1 setup. I created two zfs pools on two nodes. pve01 and pve02. I see them being available/online: root@pve01-nyc:~# zpool status pool: zfspoolpve01 state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM...
  10. B

    NUMA question

    DO I need to enable numa on VM with 2 logical cores setup with Hyper-threading ? I understand I need it with more than 2 cores for obvious reasons but I though I read somwhere that if there are only 2 cores and it is a CPU with Hyper-threading (in my case Xeon v4 family) I don't have to. Let...
  11. B

    Proxmox Ceph issues with NTP

    lucaferr wrote: I tried to synchronize 3 different nodes with a single NTP source a few hundreds kilometers away from the nodes... You need to use local NTP servers for synchronization, I would not recommend using any outside/public servers.
  12. B

    Proxmox Ceph issues with NTP

    See this post: https://forum.proxmox.com/threads/proxmoxve-ceph-clock-issue.20684/#post-105441 go to 6th post from the top from stevendemetrius. This is the instruction that I followed and had a caph cluster running for 2 years with no clock skew issues. I have two local NTP servers that I...
  13. B

    2 clusters vs. 1, ceph and VM clusters

    I have 7 nodes total. 4 dedicated for VMs and 3 for Ceph only (under Proxmox). For about 2 years they were running as two separate clusters with no issues but now we are reinstalling everything and I am wondering if there would be an advantage to create a 7 node single cluster. Any advice, any...
  14. B

    Recommended Max Ceph Disks / Nodes

    I have read somewhere quite some time ago that having 1 phisical CPU with high clock is better than having 2 CPU for ceph, is this still that case ? Also how would you know if it is time to upgrade your network from 10Gb to something faster- we are maxing out at about 1.5 Gbps when looking at...
  15. B

    Apply/Commit Latency on Ceph

    ok so I found explanation of what exactly the apply/commit latency is (before I was just comparing it to what other people were posting) which makes sens for non ssd drives and journal that is on the OSDs (no separate journal drive). Question now what can I do to improve these numbers ? Any...
  16. B

    Apply/Commit Latency on Ceph

    the network latency is fine 0.1ms between servers. I am referring to latency on OSDs. The apply / commit latency. This is when the cluster idle.
  17. B

    Proxmox Ceph issues with NTP

    I am not sure about others but i did.
  18. B

    Apply/Commit Latency on Ceph

    We are running hummer on a dedicated 3 node cluster on top of Proxmox. Using 10Gb for cluster and public networks (separate cards). All the same 16 x 10K SAS drives spread evenly among 3 nodes. We are not having any issues but I see the latency is almost never below in single digits, almost...
  19. B

    Proxmox Ceph issues with NTP

    ok thank you - we will stick to ntpd for now - seems safer...
  20. B

    Proxmox Ceph issues with NTP

    I am not sure what you mean, could you elaborate. What you are saying is that when using timesynd and a local NTP server you had no issues with clock skew on ceph - is that right ? We had two local NTP server (in case one server dies, one of them was standalone and not a VM) and with Systemd...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!