Search results

  1. hepo

    Pve cluster with ceph - random VMs reboots with node reboot

    Hi community, Recently we started observing weird behavior as follows: - VMs are migrated out of of the cluster node (1/7) - norecover and norebalace OSD flags are set - The node (pve12) is shut down for HW maintenance (ram and battery replacement) - Random number of VMs are rebooted on another...
  2. hepo

    MySQL performance issue on Proxmox with Ceph

    Hi community, needs some help with MySQL performance improvement. We have recently migrated MySQL DB (about 20GB) from bare metal to VM on Proxmox. Shortly after the DBA team started complaining about performance issues (slow queries and overall slowness). They have also ran variety of tests...
  3. hepo

    Random host reboot when moving VM disk from ceph to local-zfs

    Hi team and community, We have experienced PVE host reboot while moving VM disk from ceph to local-zfs. The local-zfs is 2 mirrored SSDs where PVE is installed. The disk move was triggered few times in attempt to troubleshoot potential ceph performance/latency issues. The host reboots are...
  4. hepo

    Fenced node emails, hundreds of them

    We had an issue on one of our nodes today, it rebooted during VM migration (local-zfs volume)... this happens for the second time now. Since then I am getting hundreds emails like the following I see no HA issues, rebooted the host once again, not sure where to start... HELP
  5. hepo

    arcstat command now working - issue with latest patch??

    I have access to 3 PBS servers and all of then create the same output. All 3 are vanilla installs with ZFS. Pushed a bunch of patches today and I am getting nervous. I was testing ZFS performance this morning and the command was definitely working! root@pbs:~# arcstat time read miss...
  6. hepo

    Improve VM restore speed - ZFS datastore over NFS

    Greetings to all, Need an advise please... We are trying to setup 2nd site (DR) on the cheap. We have a TrueNAS Core server with 40TB HDD (z2) pool. The server has 32cores and 64GB RAM. The PBS datastore is on the TrueNAS, connected over NFS. We have synced (sync job) the backups from the...
  7. hepo

    [SOLVED] Ceph (stretched cluster) performance troubleshooting

    Hi team, community, Need some help/guidance/know-how on how to proceed with troubleshooting and resolving the ceph performance issues we are currently observing. The setup The cluster is stretched primarily across 2 datacenters. The network between the DCs is 10GB/s, the latency is 1.1ms RTT -...
  8. hepo

    Stretched Cluster (dual DC) with Ceph - disaster recovery

    Hello all, new member of the forum here... looking for help and advise. We are trying to setup stretched cluster across two DC's with Ceph. Our setup is the following: - 6 nodes (3 in each DC) - We have 10 Gig network between the DC's with latency of 1.5ms - 4x2TB NVMe OSD's per node - Ceph...