Search results

  1. B

    Storage replication

    I guess these are snapshots (I am new to zfs) but that big to double the size of the original VM ? I added second VM and it also doubled the size on the drive as see in the GUI (one replication was enabled). Is there a way to deal with it somehow that is a lot of disk space... Any advice...
  2. B

    Storage replication

    Just to elaborate the GUI show: Usage 23.77% (85.66 GiB of 360.38 GiB) just for one VM of size and 42GB so it doubles the size of it. The output from the zpool list shows: root@pve02-nyc:~# zpool list NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT zfspool...
  3. B

    Storage replication

    It seems like storage replication doubles the storage for zfspool. I see it in the GUI but I don't in the CLI (the list command shows correct values). Is this a bg in 5.1.42 ? Should I ignore it ? The install , storage and replication are ok.
  4. B

    Is anybody doing HA between two geographical locations ?

    We have much more distance (1500 Miles) and latency of at least of max 40ms, we could get much lower latency if we get data centers from the same company (currently we have two data center from different companies) but even then we could not below 10ms if we would get 10ms to start with. Our...
  5. B

    Is anybody doing HA between two geographical locations ?

    What about other solutions ? Can for example VMware do this reliably (two geographical locations) , does anybody know ? ...or it needs some crazy requirements to work. Thank you
  6. B

    Is anybody doing HA between two geographical locations ?

    I wonder if it is possible with Proxmox to do the HA that way with Storage Replication across nodes in two different data centers. Any tried that ? Any other ideas ? We can get a fast and reliable link between data centers from the same data center provider. thank you
  7. B

    how to test rbd storage from client host ?

    I have an rbd storage, I can do rados bench from the ceph cluster but how would I go about testing from the client proxmox cluster ? When I try to run rados bench on the client with rbd storage I get "no monitors specified to connect to" Any help with this command appreciated. Thx
  8. B

    Best way to test Ceph

    Thank you - this seems to be exactly what I was looking for, I will give it a read...
  9. B

    Best way to test Ceph

    I have a new 3 node dedicated ceph cluster on pve5.1. I am connecting to 4 node PVE5.1 cluster with VMs over ceph public 10GB network with 2 bonded interfaces and 9000MTU size enables for private and public ceph networks. I have 18 x same 1TB drives, 10K spinners which gives me 18 OSDs. My 4...
  10. B

    zfs pool

    ok I was just able to edit the storage.conf and restart pve daemon - that did the trick. I see now local zfs pool on each node. Still wondering if there is a bug in the GUI that I was not able to see second node's pool and be able to add it.
  11. B

    zfs pool

    I understand it is a local storage. I am just adding the storage to the cluster a local storage within that particular node just like I would be adding LVM or directory but of type zfs and I don't see the second pool for the second node. What am I doing wrong ?
  12. B

    zfs pool

    I am refering to addtional storage, I have pve installed on a raid controller drive and have lvm there. I added additional hard drives to this machine and added two pools via cli: on PVE01: zpool create -f -o ashift=12 zfspoolpve01 mirror sda sdb ...and on PVE02: zpool create -f -o ashift=12...
  13. B

    NUMA question

    Thank you I am not sure if I understand. I thought that numa had 2 main objectives in multi socket hyper-visor: 1 allocate the logical cores for a VM within the same CPU socket and 2 allocate memory for a logical core within the same CPU socket ...so there is no penalty when processing. So...
  14. B

    zfs pool

    I have a two node test cluster with expected 1 setup. I created two zfs pools on two nodes. pve01 and pve02. I see them being available/online: root@pve01-nyc:~# zpool status pool: zfspoolpve01 state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM...
  15. B

    NUMA question

    DO I need to enable numa on VM with 2 logical cores setup with Hyper-threading ? I understand I need it with more than 2 cores for obvious reasons but I though I read somwhere that if there are only 2 cores and it is a CPU with Hyper-threading (in my case Xeon v4 family) I don't have to. Let...
  16. B

    Proxmox Ceph issues with NTP

    lucaferr wrote: I tried to synchronize 3 different nodes with a single NTP source a few hundreds kilometers away from the nodes... You need to use local NTP servers for synchronization, I would not recommend using any outside/public servers.
  17. B

    Proxmox Ceph issues with NTP

    See this post: https://forum.proxmox.com/threads/proxmoxve-ceph-clock-issue.20684/#post-105441 go to 6th post from the top from stevendemetrius. This is the instruction that I followed and had a caph cluster running for 2 years with no clock skew issues. I have two local NTP servers that I...
  18. B

    2 clusters vs. 1, ceph and VM clusters

    I have 7 nodes total. 4 dedicated for VMs and 3 for Ceph only (under Proxmox). For about 2 years they were running as two separate clusters with no issues but now we are reinstalling everything and I am wondering if there would be an advantage to create a 7 node single cluster. Any advice, any...
  19. B

    Recommended Max Ceph Disks / Nodes

    I have read somewhere quite some time ago that having 1 phisical CPU with high clock is better than having 2 CPU for ceph, is this still that case ? Also how would you know if it is time to upgrade your network from 10Gb to something faster- we are maxing out at about 1.5 Gbps when looking at...