Recent content by Superfish1000

  1. S

    Poor write performance on ceph backed virtual disks.

    I'm using IPoIB and not Ethernet, and all of my hardware is kind of a mixed bag of Ebay specials. The system's boot disks are actually shucked PNY 128GB SSDs that I mounted to a custom 3D printed bracket and ziptied to the back of the case because I didn't want to use one of the 3 drive bays...
  2. S

    Poor write performance on ceph backed virtual disks.

    Ouch, that balance time... I would be very interested to know how it goes for you once it is complete. I set my cluster up over a year and a half ago and just kind of took for granted at the time that my performance was super bad because of the wonky hardware. Now that I've finally gotten...
  3. S

    Poor write performance on ceph backed virtual disks.

    I can't claim any expertise there, but my understanding was that any "slow_*" values would indicate that something is bottlenecking. In this case it was related to not having enough space for the DB/WAL data which should be about 4% the size of the storage drives from what I have been reading...
  4. S

    Poor write performance on ceph backed virtual disks.

    Actually, after banging my head into the keyboard for a few days I think I might have finally gotten a lead on my issue. I have 3 active nodes at the moment with two drives 1TB/16TB drives each. (I know this is sub optimal and it's really not helping, but I don't think it's my real issue.) Each...
  5. S

    CEPH in PVE 7.3 can not working with RDMA/RoCE?

    So from my testing it does appear that the commands I mentioned above work. This should allow you to set these values on a per node basis. As for performance changes, @realguob, @alexskysilk, what kind of performance changes did you see if any? I am pretty sure I identified other serious issues...
  6. S

    Poor write performance on ceph backed virtual disks.

    I hate to necro a thread like this, but I also am curious what happened for everyone here. When I set up my current cluster I thought I'd try out CEPH, and I've been impressed by a lot of it's ability. The performance on the other hand is downright abysmal and I'm struggling to determine why...
  7. S

    CEPH in PVE 7.3 can not working with RDMA/RoCE?

    Okay, so... If I'm understanding this correctly it is possible to do this, though you can't do it in the config file. It looks like CEPH is shifting away from a config file to a configuration database. This appears to be the only way you can do it...
  8. S

    CEPH in PVE 7.3 can not working with RDMA/RoCE?

    I wasn't sure on this at first either. From @realguob's original note though it looks like they need to be un-linked so they can be edited individually. Right now I'm looking to see if there is a way I can specify the GUIDs for each node without needing to unlink them. I'll update if I find...
  9. S

    ACME certificate HTTP method not opening port 80 for IPv4

    I haven't had a lot of time to mess with this, but my situation is that I have 4 identical servers and one that is running different physical hardware, but is otherwise configured identical that are all working with the exception of this one node. I've dug through the logs for a few hours now...
  10. S

    ACME certificate HTTP method not opening port 80 for IPv4

    I have been having exactly the same issue on one of my servers for a bit now. Just had the time to figure out what was causing it. Did you ever end up getting this resolved? The other thread I found talking about this just ended how many of them seem to, descending into numerous requests for...
  11. S

    [SOLVED] Shrink disk on Ceph

    I spent like 10 minutes trying to figure out why this didn't work before realizing I had a typo and put "rdb" instead of "rbd." I feel dumb. lol Thank you for posting this. Super helpful.
  12. S

    Single node rebooting/sync issue causes entire Datacenter to malfunction

    I have been having a consistent and incredibly frustrating issue where a single node in my datacenter being rebooted causes the entire datacenter to fail and the web GUI to malfunction and become useless. I then need to log into the node(s) over SSH and either restart cluster related services...
  13. S

    [SOLVED] Spice "Connecting to graphic server" indefinitely with ACME cert installed.

    How would I have changed this? I suppose it's possible but I would have had to manually edit the renewal script for the built in automated ACME GUI. I didn't do anything (this time) that wasn't a GUI option. ACME didn't originally mess up the pve-ssl.pem file. It got messed up on automatic...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!