Search results

  1. T

    migration to other node's local storage : qpm command got timeout

    Replying to myself after trying this out : restarting these services doesn't affect running vms it didn't work with 8 seconds, so I increased the timeout to 120 seconds, then it worked
  2. T

    migration to other node's local storage : qpm command got timeout

    Hello, We have a Proxmox HA cluster with 3 nodes. Each node has vms on its local storage. We know it's not the best scenario, but we are stuck with it for now, due to our hoster's shortcomings. Anyways, when we try to live migrate a vm from a node's local storage to another node's local...
  3. T

    Proxmox cluster with local storage - hv fencing when high io usage

    You're right, sorry I forgot to post logs. hv1 is the node that rebooted. Its logs show nothing indicating a proper shutdown. It goes straight from "business as usual" to startup logs. Here are the corosync logs from hv2 indicating connection to hv1 was lost, hv1 was removed from the cluster...
  4. T

    Proxmox cluster with local storage - hv fencing when high io usage

    Hello, I am experimenting with a Proxmox cluster using 3 nodes, and vms on local storage. We also have a shared storage, but due to serious performance problems with this storage, we are trying to get rid of it. I know that shared storage is obviously needed for HA, but we don't have control on...
  5. T

    Live migration : understanding logs and optimizing settings

    Bump, hoping for some interesting conversation on this subject !
  6. T

    No network after reboot - dependency issue

    Hi, Have you switched packages between ifupdown and ifupdown2 ? I had similar problems with the ifupdown2 package postrm scripts altering /etc/network/interface file and disabling the networking service. Make sure you don't run into the same issue.
  7. T

    Live migration : understanding logs and optimizing settings

    Hello, I am trying to fully understand a live migration log, and to find settings that enable it to perform better. The operation was a live migration with shared storage (iSCSI) so only the VM state was transferred. I uploaded the migration log on https://pastebin.com/VtDgQUw6 I am trying to...
  8. T

    shared iSCSI : VM cloning very slow, and stalled at 100%

    Replying to myself : the IO wait on the kworker thread and on iscsiadm may be due to them waiting for IO (since IO is clogged by vm cloning) and since they both have 0 bytes read or written, I think I should not be worried about them. Also, I launched a VM cloning operation on another node in...
  9. T

    shared iSCSI : VM cloning very slow, and stalled at 100%

    Hello, We have a Proxmox 7.1 cluster, with 3 nodes. VMs are on LVM over a shared iSCSI storage. Storage access from the nodes reaches between 100 and 400 MiB/s for a sequential read. Cloning a VM is very slow, with 2h 40min spent for cloning a 50 GiB VM (that's a bit more than 5 MiB cloned /...
  10. T

    [SOLVED] Adding a new node to an existing cluster with redundant links

    Thank you @aaron , I had to use the --link0 and --link1 options to specify the IP addresses for the new node, and I was also missing this part in /etc/corosync/corosync.conf on the existing nodes : interface { linknumber: 0 } It had only the lines for linknumber: 1, I duplicated them...
  11. T

    [SOLVED] Adding a new node to an existing cluster with redundant links

    Hello, I am trying to join a new node to an existing cluster. The cluster has redundant links. The /etc/corosync/corosync.conf file on an existing node looks like this : logging { debug: off to_syslog: yes } nodelist { node { name: pve1 nodeid: 3 quorum_votes: 1...
  12. T

    Some notes and questions about Proxmox Cluster networking

    Well, kind of, but it is useful. It hides the SSH server from many scanners. You should have best practices in place anyway, like blocking attackers (for example with fail2ban), disabling root login (which you cannot do on a Proxmox cluster) and disabling password authentication. I believe...
  13. T

    Some notes and questions about Proxmox Cluster networking

    Thank you both for the explanation regarding corosync / kronosnet networking, it is clearer now. I botched my iptables rules so I didn't think it used these ports, but I can now confirm that corosync uses ports 5405 and 5406 / UDP on my cluster, as I use 2 links between my nodes. Are you sure...
  14. T

    Some notes and questions about Proxmox Cluster networking

    Hello, I am trying to find more information about Proxmox Cluster networking, and specially the use of ports 22, 5404 and 5405 for intra cluster communication. I feel like the PVE admin guide could be updated with more accurate information (some of which I am contributing in this thread). I...
  15. T

    iSCSI storage encryption for a cluster

    So, I setup Proxmox with iSCSI / LUKS / LVM like this : iSCSI access added to Debian OS : apt-get install open-iscsi vi /etc/iscsi/iscsid.conf [tune config and reboot] iSCSI storage added to Proxmox using web-GUI whole iSCSI device encrypted with LUKS : cryptsetup -v luksFormat /dev/sdd...
  16. T

    iSCSI storage encryption for a cluster

    Hello, I am setting up a Proxmox cluster with 3 servers, and 1 shared iSCSI storage. It seems that I can only access this storage in iscsi mode (I asked a question about this at https://forum.proxmox.com/threads/zfs-via-iscsi.74843/post-378849) With this setup, what are my options for VM...
  17. T

    ZFS via iscsi

    Hello, I have a 3 node Proxmox cluster, with shared iSCSI storage provided by Online (see specs here : https://www.scaleway.com/en/dedibox/storage/rpn-san/) The storage only provides acces to iSCSI LUNs, so that means I'm stuck with using the storage as iscsi inside Proxmox, for shared access...
  18. T

    Does Proxmox check storage every 20 seconds ? [syslog: Very big device. Trying to use READ CAPACITY(16)]

    I setup a Proxmox cluster, 3 nodes with an iSCSI storage. The servers' syslog is spammed by this message every 20 seconds : Mar 22 00:03:34 hostame kernel: sd 8:0:0:0: [sdd] Very big device. Trying to use READ CAPACITY(16). According to some info I found about this message ...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!