Search results

  1. F

    Configure Qdevice with two HA links.

    Hello, I have some clusters with 2 HA links and 4 nodes, 2 nodes in one rack and 2 nodes in another rack. I want to manage a rack crash so two nodes down and a HA link crash. Can I have to add one Qdevice on the two HA links or only on one HA link or I need two Qdevices one for each HA links...
  2. F

    Proxmox Cluster with local Gluster servers.

    Zubin, >> Gluster does not like Hardware Raid? Even if the filesystem Gluster Sits on is XFS? Hardware Raid is not necessary, Gluster manage the Raid in your case 3 replicats (same if you use zfs, btrfs, lvm raid). You need 2 switchs to avoid a spof, If the unique switch crash ("same" problem...
  3. F

    Proxmox Cluster with local Gluster servers.

    Zubin, For the Network you have 2 switches (10G/1G) or 2 switches (10G), 2 switches (1G) Storage, VM memory migration, VM production, HA (Bond 2x10G), HV and VM management, HA (Bond 4x1G) or Storage, VM memory migration, HA (Bond 2x10G), HV and VM management, HA (Bond 2x1G), VM production...
  4. F

    Proxmox Cluster with local Gluster servers.

    Hi Zubin, Yes it is working, the problem is the shutdown of a node, Gluster do not stop correctly with Debian (I do not test if the problem is solved now). >> Each 1TB is formatted with XFS, because it doesn't do the raw disk, correct? yes and do not use hardware raid for GlusterFS. >> Seems...
  5. F

    One or more devices could not be used because the label is missing or invalid

    Hello, I had a "similar" problem after a reboot I had two disks reversed and set FAULTY (with label invalid) and I have the same error messages than you with the "replace". [0:0:4:0] disk xxxx xxxxxxxxxxx xxxx /dev/sde [0:0:5:0] disk xxxx xxxxxxxxxxx xxxx /dev/sdd...
  6. F

    [TUTORIAL] PVE 7.x Cluster Setup of shared LVM/LV with MSA2040 SAS [partial howto]

    Hello Glowsome Yes sorry the correct path for the file is "/etc/systemd/system/lvmlockd.service.d/". I do not understand. Best regards. Francis
  7. F

    Proxmox Cluster with local Gluster servers.

    HI Imran, Of course but not so much and you have the LVM capabilities, change disk size, increase LVM size, move data online, etc... If you have time to compare with and without LVM you are welcome. Best regards. Francis
  8. F

    Proxmox Cluster with local Gluster servers.

    Hi Imran, Gluster can not have direct access to the disk, Gluster is on top another filesystem. You have to: - configure the 10x4TB disks in JBOD, - put the 10 disks in a Volume Group, - create a Logical Volume on each 10 disks (1LV -> 1DD), - create a filesystem (ext4/xfs) on each 10...
  9. F

    Proxmox Cluster with local Gluster servers.

    Hi, I suppose you use the two Storage Server (SS) for the Gluster servers and the Proxmox Server (PS) as a Gluster client and you have a bond of 2x10Gb back to back for the SS's and another bond 2x10Gb to connect via a switch the PS. For Gluster do not use hardware raid, gluster have its own...
  10. F

    Proxmox Cluster with local Gluster servers.

    Hi imran.tee, The performance of GulsterFS depend on your disk, network bandwidth, number of nodes, etc... generally you have good performance. ISCSI on top of GlusterFS no, but why ? For GlusterFS you do not need iSCSI for iSCSI you do not need GlusterFS. With iSCSI you can be a Target...
  11. F

    Configure fence device /etc/pve/ha/fence.cfg ?

    Hi mgabriel, Thank I know that but we need to have small "isolated" two nodes clusters, we do not want/cant manage raspberrys and we can not have VMs on another clusters (isolated cluster). For us Two nodes and fence is the best solution, why fence is remove ??? On some clusters we want to...
  12. F

    Configure fence device /etc/pve/ha/fence.cfg ?

    Hi mgabriel, Thank you, but for QDevice I need another node. Best regards. Francis
  13. F

    Configure fence device /etc/pve/ha/fence.cfg ?

    Hello UdoB, Thank you for your reply I have already read this documentation, in fact I think I have read "all" the documentations... The cluster is a test but for the corosync/dlm (I used iSCSI/LVM/gfs2) I have a back to back Ethernet cable. For a two nodes cluster I have to configure a fence...
  14. F

    Configure fence device /etc/pve/ha/fence.cfg ?

    Hello, I have a two node cluster. How can I configure a fence device with proxmox VE 7.x ? What is the schema of the /etc/pve/ha/fence.cfg file ? Best regards. Francis
  15. F

    Proxmox Cluster with local Gluster servers.

    Hello, At the system shutdown/reboot the glusterd service stop but the glusterfsd process do not so the umount of the brick failed. I see some articles about a change in gluster where a stop of the glusterd do not stop the glusterfsd process. To stop the glusterfsd process we have to stop the...
  16. F

    [TUTORIAL] PVE 7.x Cluster Setup of shared LVM/LV with MSA2040 SAS [partial howto]

    Hello, I changing "Before=pve-guests.service" by " Before=pve-ha-lrm.service pve-guests.service" all work fine I can start/stop the nodes. [Unit] Description=LVM locking LVs and mount LVs start and stop Documentation=man:lvmlockd(8) After=lvmlocks.service lvmlockd.service sanlock.service...
  17. F

    [TUTORIAL] PVE 7.x Cluster Setup of shared LVM/LV with MSA2040 SAS [partial howto]

    Hello, With " Before=pve-guests.service" the node startup work fine. But when I shutdown/restart the node, the HA VMs do not stop and the gfs2 filesystem cannot umount... (fuser say filesystem in use by kvm). I tested the command "pvesh create /nodes/localhost/stopall" used by the...
  18. F

    Proxmox Cluster with local Gluster servers.

    Hello Dark26, Thank you, I know the problems with two nodes I have only two servers so no node for arbiter but I planned to use fence. my gluster nodes = proxmox nodes, the gluster network is in back to back (corosync network is also back to back). Volume Name: gv1 Type...
  19. F

    Proxmox Cluster with local Gluster servers.

    Hello, My purpose is to use gluster to implement a very easy replicated local storage (like VMWare vsan). I have a Proxmox cluster with node1 and node2 and some local disks. I installed the gluster server on each nodes and create a gluster volume (distributed/replicated) with the local disks...
  20. F

    [TUTORIAL] PVE 7.x Cluster Setup of shared LVM/LV with MSA2040 SAS [partial howto]

    Hello, LVM shares need to be up before the guests starts we can add this to the unit lvmshare.service "Before=pve-guests.service" [Unit] Description=LVM locking LVs and mount LVs start and stop Documentation=man:lvmlockd(8) After=lvmlocks.service lvmlockd.service sanlock.service dlm.service...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!