Search results

Thanks for your reply Aaron. The issue is still present so we have taken the port out of the LAG which resolves everything. We can't work out exactly what the cause is. Out of the LAG the interface in question is capable of transferring 9GBit/s (on a 10GBit link) with no problem. As soon as...

Hi, We have a three node setup, each of which is running Proxmox & Ceph. Each node has a four-port 10GBit link. Two ports for Ceph and two ports for public/private networking. There are also two 1GBit ports used purely for Corosync. Link aggregation for Ceph works great, Ceph is nice and...

@fiona I have just run into the same issue and this resolved it for us. Thank you!

Thank you Fabian - we'll run the updates on our nodes now. Appreciate the fix! Chris.

Just to confirm this issue has been resolved by changing the storage to use KRBD. Although, I'm not quite sure why this should be the case?

Hi, I raised this topic as I was having issues backup up a large 3.6TB guest - https://forum.proxmox.com/threads/cannot-backup-3-6tb-ceph-guest-iowait-through-the-roof.109232/#post-473772 Since switching the drives over to run via KRBD I've been able to run unthrottled backups without hitting...

Hi @fabian, I have finally managed to get around to running an on-site PBS that syncs off to remote. Unfortunately, we're still getting high IOWait and unresponsive services as a result, meaning I'm unable to complete the backup. I don't suppose you can offer any more insight? In terms of IO...

When I initially installed the drives I was disappointed to see we were still having issues as we started to apply load. It was mainly the IOWait of guests rather than apply/commit figures. Turning the write cache off and setting to write through definitely helped us. Although this was done...

I thought it'd be good to follow up on this off the back of @Deepen Dhulla's like... Long story short, EVO's just don't cut it when it comes to Ceph. In the end we replaced all 12 drives with Samsung PM893 3.84TB SATA SSD's. These have power loss protection which is what Ceph depends on for...

Thank Stoiko, Very useful indeed! Appreciate your help and I'll mark this as solved as it seems to be nothing to worry about. I just wanted to check it wasn't the result of a misconfiguration. Chris.

Hi, I've installed and configured PMG. We're relaying email both inbound and outbound via a smarthost. I noticed on the headers that I get the following - Received: from mxserver.example.net (localhost.localdomain [127.0.0.1]) by mxserver.example.net (Proxmox) with ESMTP id 69FD7201062...

Thanks for your help - I'll take a look at this. Luckily we have enough local storage for this at the minute :)

Thanks for your response. We're backing up to a spinning rust off-site storage so it won't be anything fast. Is there any way I can work around this, i.e. backup locally and then remotely? We need remote backups as part of our backup strategy. Thanks, Chris.

I have a 3.6TB guest which was backing up fine (runs on Ceph), upgraded our nodes on Saturday and now I'm having to cancel the backup because it's causing the guest to become unrepsonsive during the process. I can see it looks like it's having to rebuild from scratch, but thought this wouldn't...

Interesting you should raise this. I upgraded yesterday and was just coming to the forum to ask about backup issues. I have a 3.6TB guest which was backing up fine (runs on Ceph), upgraded our nodes yesterday and now I'm having to cancel the backup because it's causing the guest to become...

When I created my Proxmox cluster, I installed Ceph and did some testing. We had a few issues with Ceph so I followed some guides on uninstalling it from Proxmox. Now we've recreated our cluster and it's working nicely. However, when I reboot one particular node (pve01), it takes 15-20 minutes...

Hi Aaron, I've had a breakthrough on this today. I have 3 nodes that were originally spec'd by our provider with Samsung EVO 870's (useless for Ceph) so we're in the process of swapping them out with Samsung PM893's. We added one PM893 to each node just to test and this is where the benchmarks...

Hi, We've installed a 3 node Proxmox cluster running Ceph. On the cluster we have two VM's. When we reboot all PVE nodes, the IOWait of the VM's drops to pretty much nothing. However over time, the IOWait creeps up - there is no load on these VM's. Any idea why this might be? As you can see...

@spirit those are pretty good stats. We've just replaced our cluster (3 nodes, 1 DC) with 3 x 3.84TB Samsung P893's (with another 9 on order, so 4 per node). We have Intel Xeon E5-2697 configured in performance mode so 2.3GHz / 3.6GHz turbo per core. Running the same FIO benchmark within a VM...

@hepo have you got any further with this? Have you tried running a rados benchmark against a newly created pool? We're also finding writes are heavily restricted when running on a VM itself.