bbgeek17's latest activity

  • bbgeek17
    This articles may be helpful to you as you fine tune your environments: https://kb.blockbridge.com/technote/proxmox-lvm-shared-storage/ https://kb.blockbridge.com/technote/proxmox-tuning-low-latency-storage Blockbridge : Ultra low latency...
  • bbgeek17
    @nwad , to ensure that you don't miss the output from the console you can execute these commands via SSH terminal: script serial.log qm terminal [vmid] and leave it running. Another option that we use in our testing is to add char device...
  • bbgeek17
    Hi @ManFriday , Out of curiosity - how large if your environment? Nodes, VMs, etc? What is your current max? sysctl net.netfilter.nf_conntrack_max Write a basic loop to log number of connections, every 1-10seconds, along with date. That should...
  • bbgeek17
    I can only see this happen if the VM is powered off, then PVE HA will try to start it, potentially detect storage outage (as you correctly noted there seems to be no redundancy there), and then start it on another host. Linux Kernel will try IO...
  • bbgeek17
    Hi @petruzzo, Can you provide the details: - actual command line you run with full output, good and bad - output of "pvecm status" - output "tail -f /var/log/pveproxy/access.log" during API execution - output of "journalctl -f " during command...
  • bbgeek17
    Hi @el_vagokz , welcome to the forum. There is no special sauce in PVE to enable automatic HA migration of VM nodes when storage connectivity is lost. Have you looked at the Windows logs during the failure window? Is it possible Windows shuts...
  • bbgeek17
    Hi @Jan Wedershoven , I seem to recall a few reports similar to yours. For example: https://forum.proxmox.com/threads/proxmox-cluster-of-21-nodes-falls-out-of-sync-when-a-single-node-is-added-or-removed.153149/ I'd recommend pursuing an official...
  • bbgeek17
    bbgeek17 replied to the thread iSCSI under performance.
    Ugh, sorry to hear that. When your support contact calls Proxmox "the operating system", you know things are not going well. That said, for people who invested in storage systems that do not officially support PVE, we recommend hiding the PVE...
  • bbgeek17
    bbgeek17 replied to the thread Sizing calculator.
    "ZFS over iSCSI" is a special scheme that involves root SSH access into the storage appliance, requires the storage appliance to run ZFS internally, and directly manipulates said ZFS. And, of course, exporting the resulting ZFS volumes via iSCSI...
  • bbgeek17
    bbgeek17 replied to the thread Windows guest IO performance.
    One more question: For the LVM storage that you tested against. Did you have the "Allow Snapshots as Volume-Chain" enabled? It's critically important to understand whether you are testing on a native LVM LV or a QCOW nested within an LV. The...
  • bbgeek17
    bbgeek17 replied to the thread Windows guest IO performance.
    What caught my attention was the claim of reaching 400K IOPS inside a VM at queue depth 4. In practice, most NAND-based NVMe devices can’t sustain that level of performance. A partial explanation might be that your sequential I/O pattern...
  • bbgeek17
    bbgeek17 replied to the thread Best practic cluster proxmox.
    Also, note that 192.90 is not a private IP space https://datatracker.ietf.org/doc/html/rfc1918#:~:text=3. Private Address Space Blockbridge: Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
  • bbgeek17
    bbgeek17 replied to the thread Best practic cluster proxmox.
    You should place a switch on the back-end network. Blockbridge: Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
  • bbgeek17
    bbgeek17 replied to the thread Best practic cluster proxmox.
    There is no "backup" traffic in basic PVE cluster. It is something you can add with an external node, ie PBS. Do you mean ZFS replication? If you do not have shared storage, then the VMs cannot failover when node fails. Are you planning to use...
  • bbgeek17
    bbgeek17 replied to the thread Best practic cluster proxmox.
    Hi @pelip , welcome to the forum. To answer your question directly : it is impossible for anyone to say as you provided insufficient data for analyses. Note that 10G is an overkill for Cluster communication. Are you running Ceph as well...
  • bbgeek17
    bbgeek17 replied to the thread Windows guest IO performance.
    Hi @Antrill , welcome to the forum. Can you post your fio job definition? Blockbridge: Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
  • bbgeek17
    bbgeek17 replied to the thread Sizing calculator.
    No , ZFS is not a Cluster Aware file system. Take a look at storage Wiki page for PVE for shared storage recommendations. https://pve.proxmox.com/wiki/Storage Blockbridge: Ultra low latency all-NVME shared storage for Proxmox -...
  • bbgeek17
    bbgeek17 replied to the thread Missing pve entry?.
    Great! Feel free to mark this thread as solved then by editing the first post and selecting the prefix from subject dropdown. That will help to keep forum tidy. Blockbridge: Ultra low latency all-NVME shared storage for Proxmox -...
  • bbgeek17
    bbgeek17 replied to the thread Sizing calculator.
    There isn’t a single answer that fits all environments, or even a set of best practices you can apply formulaically. The sizing really comes down to: The number of physical CPUs you have today The number of virtual cores you’ve provisioned Your...
  • bbgeek17
    Glad I could help. You can now mark this thread as Solved to keep things tidy. You can do this by editing the first post and updating the tag via dropdown near the subject Blockbridge: Ultra low latency all-NVME shared storage for Proxmox -...