Search results

  1. S

    Proxmox with a Separate Host Running OpnSense in Hetzner

    Hi all, I'm working on my first setup at Hetzner and I can't find any examples of what I am attempting to do. I'm hoping for some insight, an interfaces config or step by step if it's available would both be very helpful! While there's plenty of instructions with regard to hosting OpnSense...
  2. S

    Difficulty with OOM / CGroups

    Hi All, Coming from 20 years as a professional in Windows (2 years of hands-on Linux) I'm having issues with fully grasping cgroups. I recently upgraded my server cluster and am I encountering OOM kills regularly (a few times per day). I have a single cgroup (just out-of-the-box config). My...
  3. S

    Error when trying to replicate/failover

    OK, so, yes… -RpvL does the trick. Don't generally like modifying code unless it's my project, yet this works for the time being. Thanks again!
  4. S

    Error when trying to replicate/failover

    I see there's a little hack at the top, so I've added -L to the procedure, we'll give it a try now!
  5. S

    Error when trying to replicate/failover

    Thanks for that, so it's broken in Proxmox. Do the devs happen to have a fix planned? Seems like a really large issue that HA/failover is completely broken for anyone who's running a blocksize larger than 128K. It's good practice to match your workload. Looking forward to the fix! :) All...
  6. S

    Error when trying to replicate/failover

    Hello! I am working on setting up HA/replication this evening. I have 2 boxes and an arbiter node in the cluster. The replication only occurs between the two main nodes, PVE and PVE2. There's no shared storage, so everything is snapshots and local ZFS DAS. The boxes are interconnected at 40...
  7. S

    Connect-x 3 ROCe Configuration

    There's an issue with RoCE, it's not an option for the Connectx-3 cards. NVIDIA has stopped including it in their newer builds. The latest build that does support it, referred to as LTS, supports Ubuntu 20.04 and won't install. They promised a refresh, yet it's about a year late. So, if...
  8. S

    Connect-x 3 ROCe Configuration

    I hadn't tried this one, yet it is missing steps, hence why I asked for help. I played with ib today with little success, going back to RoCE, much more in my wheelhouse.
  9. S

    Connect-x 3 ROCe Configuration

    Hey all! I've been looking for a step by step to configure RoCE on the latest Proxmox. I am using Connectx-3 dual port cards and an interconnect cable that supports both InfiniBand and Ethernet natively, no switch involved. Likewise, I have is set up for Ethernet on both ends, and it works...
  10. S

    Docker on Proxmox

    I just want a workable solution. It's not a big ask...
  11. S

    Docker on Proxmox

    May want to read my whole post. It explains why VMs are not an option as well as why I'm using privileged containers.
  12. S

    Docker on Proxmox

    Hi All, I am redoing my entire home cluster, adding storage, moved to more powerful servers. Presently copying files around, takes forever, yet gives me time to make decisions. I am having trouble with docker and how to go about implementing it. In my previous implementation, I was using LXC...
  13. S

    docker: failed to register layer: ApplyLayer exit status 1 stdout: stderr: unlinkat /var/log/apt: invalid argument.

    I've found a few more things to play around with since the last time I posted in this thread. 1. Use fuse-overlayfs, you need to install the package via apt on the guest first. You can then alter the storage driver in the daemon config. Shut down the CT and change the box in options to...
  14. S

    docker: failed to register layer: ApplyLayer exit status 1 stdout: stderr: unlinkat /var/log/apt: invalid argument.

    This is true, yet presently I don't know of a workaround. I saw some feedback from the 6.x kernel saying it fixed the issue, I gave it a try, yet still the same error on specific containers, for example NGINX Proxy Manager.
  15. S

    [SOLVED] Today's Kernel / Firmware Update has really messed up my boxes!

    Glad to help, issue I have with any VM passthrough is that it's exclusive. I think you'd be best off to just load docker on your Proxmox host. May take some work yet if you can assign a zfs pool that seems like a good option. Other option would be overlay 2, yet I believe they requires EXT4.
  16. S

    [SOLVED] Today's Kernel / Firmware Update has really messed up my boxes!

    It'll work, yet fuse-overlayfs gave me issues with my backups to my Proxmox Backup Server. It showed up as permission errors during the backup, anywhere that I had nested docker. When I tried a restore, none of my Docker containers were functional as it was unable to backup...
  17. S

    [SOLVED] Today's Kernel / Firmware Update has really messed up my boxes!

    Yes, I know, yet I've been using it, by default for over a year now on this box, and it's been fine. I don't know of any other way to go about fixing this, other than moving to bare-metal. If you have any recommendations, I'd be happy to explore options. Thanks!
  18. S

    [SOLVED] Today's Kernel / Firmware Update has really messed up my boxes!

    Note: If you run PBS, it won't work with the overlay file system. So, my suggestion at the moment, stick with VFS. Or, if you're so inclined, move your docker to the host server and avoid all of this fun! :)
  19. S

    [SOLVED] Today's Kernel / Firmware Update has really messed up my boxes!

    Another solution: --- NOTE: Not advised, broke my backups, I'm back on VFS for now. This would be the best choice if it worked with PBS, unfortunately, it doesn't at the moment. https://theorangeone.net/posts/docker-lxc-storage/ vfs also works, so you can run in that manner and collect your...
  20. S

    [SOLVED] Today's Kernel / Firmware Update has really messed up my boxes!

    ok, I changed to vfs and everything came back. This will probably break most docker installs that are running on Proxmox in LXC, so this will hopefully be helpful for people. If anyone can chime in, is there any way to use a more performant driver with the nested config? I'm about to redo my...