Search results

  1. C

    PBS - Backup Storage

    Hi, You can find recommended requirements for OS drive here: https://pbs.proxmox.com/docs/installation.html#recommended-server-system-requirements The easiest way to go is to use two small mirrored drives for boot and two 1TB mirrored NVMe drives as a datastore. If you cannot use dedicated...
  2. C

    CEPH Total size increases when one node is down

    Hello, I'm testing a 3-node cluster with Ceph, and I noticed that when one node is down, the total size of the ceph storage in the GUI increases. Here's the config for each node: pve01 2 x 32GB Boot disks with ZFS mirror 2 x 50GB OSDs pve02 2 x 32GB Boot disks with ZFS mirror 2 x 50GB OSDs...
  3. C

    Stuck ZFS replication on VMs with QEMU Guest Agent

    Update: The replication of VM 501 just finished. Here's the complete replication log. The snapshot creation starts exactly one hour after "freeze guest filesystem". Between 8:31 and 9:31 we stopped qemu-guest-agent and VSSVC.exe inside the VM. It randomly makes the replication continue, but...
  4. C

    Stuck ZFS replication on VMs with QEMU Guest Agent

    Hi, In a cluster with several nodes replicating between them, we noticed that sometimes ZFS replication task gets stuck on Windows VMs when freezing guest filesystem. Agents are updated to the last version. Here's the replication log when the issue happens: 2024-02-08 13:50:01 321-2: start...
  5. C

    Restoring from backup powers off server

    Hi, I write just to confirm the motherboard change also did the trick for us. Now everything works as expected. I hope this can help to someone else!
  6. C

    Restoring from backup powers off server

    Thanks for your update. I agree that it may be a hardware fault, but it's very hard to replicate. I'm waiting for the motherboards replacement. Let's see how it goes. I've got also some nodes with GIGA MX33-BS1-V1, but for now I've had no problems with these.
  7. C

    Restoring from backup powers off server

    Hi Brendon, You're not the only one, similar problem here with the same motherboard (Gigabyte MX33-BSA-V1F) and ZFS striped mirrors. Very frustrating. In my case I have 10 PVE nodes, 3 of them have this motherboard and I've been experiencing different issues with them, all related to...
  8. C

    [SOLVED] Error upgrading several PVE 5 nodes

    Hi Thomas, Thanks for your help, I'll mark this post as solved. Best regards, Carles
  9. C

    [SOLVED] Error upgrading several PVE 5 nodes

    Hello, We're upgrading several old PVE5 nodes (all of them with subscription), and we're facing this error: root@pve1:~# apt update Hit:1 http://security.debian.org stretch/updates InRelease Ign:2 https://enterprise.proxmox.com/debian/pve stretch InRelease Ign:3...
  10. C

    Recommended RAM for ZFS

    Thank you for the information, I saw a paper about CEPH but not this one about ZFS. As far as I can see, the performance is reasonably good, taking in account that in the paper, ARC is being limited to 4GB: # limit maximum ARC size options zfs zfs_arc_max=4294967296 I'll try to put the NVMe...
  11. C

    [SOLVED] Moving from no-subscription to enterprise

    Hi, Just for reference, I ended up installing the ISO via IPMI. Everything worked as expected.
  12. C

    Recommended RAM for ZFS

    Hi, Can we expect at least the same performance in those two scenarios? HWRaid with WriteThrough + SSD: Intel Xeon E-2288G 128GB RAM 4 x 960GB SSD in RAID10 with hardware controller. NO HWRaid + NVMe + ARC limited to 16GB: Intel Xeon E-2288G 128GB RAM 2 x 1,92 TB NVMe SSD in ZFS Mirror...
  13. C

    Recommended RAM for ZFS

    On the Wiki (System Requirements: https://pve.proxmox.com/wiki/System_Requirements), is stated that recommended requirements are 2GB for the OS + 1GB per TB, maybe someone from Proxmox Team can confirm it? If those really are the recommended requirements, 16GB should be more more than enough...
  14. C

    Recommended RAM for ZFS

    Hi Ramalama, I know that ZFS uses 50% by default, that's why I want to limit it, I don't want to lose 64GB of RAM when now I'm using 100GB of 128GB. So, in theory, no matter how much limit I put for ARC (i.e. max 15GB), since I'm using NVMe the performance would be at least the same as now...
  15. C

    Recommended RAM for ZFS

    Hello, We've a 5 node cluster with local storage. All servers are the same: Intel Xeon E-2288G 128GB RAM 4 x 960GB SSD in RAID10 with hardware controller. We try not to provision more than the 80% of RAM (100GB+-) to have room for balancing VMs if necessary. The point is that we miss ZFS...
  16. C

    [SOLVED] Moving from no-subscription to enterprise

    Thank you for the clarification. I've opened a ticket with the provider asking if it's possible to install from PVE5 template. If so, I'll install PVE from it and then upgrade to PVE6 with the enterprise-repository. If that's not possible, I'll try to mount the iso via IPMI and do the...
  17. C

    [SOLVED] Moving from no-subscription to enterprise

    Hi, It seems not possible to install from the ISO. What we did in previous installation was to use a template from an old PVE, i.e. PVE5, then add the subscription and then upgrade to PVE6. We cannot do this because PVE5 template is not available anymore. Here are the package versions that the...
  18. C

    [SOLVED] Moving from no-subscription to enterprise

    Hello, We've a 4 node cluster hosted in a cloud provider. All nodes have a basic subscription. Now we've acquired a new node, and the installation template from the hoster comes with the pve-no-subscription repository. I know that I need to comment the pve-no-subscription entry at...
  19. C

    Hyper-V Not Working

    Hi, Have you tried using CPU=host on the VM config, instead of Cascadelake-Server? Also, maybe you already did, but here is the wiki entry for Nested Virtualization: https://pve.proxmox.com/wiki/Nested_Virtualization Regards
  20. C

    Adding new PVE 6 node to a cluster which is being upgraded from PVE 5.4 to PVE 6

    Hi, nodes 2 and 3 cannot afford more VMs (no resources available). That's why I asked about adding another node when node1 failed. Right now, technicians are replacing node1 motherboard. Do you think it's better to move vms to node1 when fixed instead of adding a new one? (we'll do that...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!