Search results

  1. B

    Problem joining cluster

    I tried to add a 5th node to my cluster, and it appears in the running cluster but as offline. I see the correct corosync config on the cluster, but when I look at the new node it did not get an updated corosyn.conf file (in /etc/pve, it did in /etc/corosync), and it will not let me login to...
  2. B

    Backup: Odd slowness on one host in cluster

    Rebooting seems to have resolved it for now, my previous hdparm result was about 10MB/s
  3. B

    Backup: Odd slowness on one host in cluster

    Yea, I just put that and the ionice in there yesterday to see if it made any difference, and I've tried huge number and tiny numbers with really no effect. I've just rebooted the node to see if that makes any difference. I'll reset the options to default and rerun when it's back up.
  4. B

    Backup: Odd slowness on one host in cluster

    4/1 - see below. I've moved all of my guests off of this machine so I can troubleshoot. The network config is the same as the other nodes, 1G .102 subnet for corosyn, 10G .100 for default network and 10G .101 for storage. The base network is working - another iperf run is below. I'm starting...
  5. B

    Backup: Odd slowness on one host in cluster

    I'm getting some odd slowness in one member of my cluster. When the backup runs it shows about 3/3MB backup speed (even though iperf3 to the FreeNAS NFS store is 9GB/s) but after migrating to another cluster member it's much faster. Backup from below is on NODE2 (svr-02), slowness is on NODE1...
  6. B

    Strange share performance issue

    so, as soon I posted that it started working properly. What I've been able to determine is that the second port on the Node's 10G card brings the switchport down on VLAN101 when in any of my SFP+ ports, but it works fine in the copper ports. I've also confirmed that my laptop and other Nodes...
  7. B

    Strange share performance issue

    I'm seeing a very odd and difficult to troubleshoot disk share performance issue in case anyone has thoughts. I have a 4 node PVE cluster, server by a few nodes of FreeNAS with NFS shares. One of the FreeNAS boxes is new, with SSD storage, and as part of bringing it online, I have rearranged...
  8. B

    PVE Backup Speed Optimization

    OK, that's worth looking at. When I do that I get much slower writes than reads (skewed the same as the backup but different magnitudes-by about 2x). The writes were 50-80MB/s, but the reads were near 200MB/s. This test was with ~1,000 small eBook files that made up about a 5GB transfer. So...
  9. B

    PVE Backup Speed Optimization

    HA on FreeNAS boxes - No, each FreeNAS box can fail, and Yes, it is a SPOF, my HA setup is only for the VMs within ProxMox. It is still a homelab. I do rsync the Images between boxes for backup, but I don't have enough storage to replicate all of my data between the boxes, and I'm not...
  10. B

    PVE Backup Speed Optimization

    Yes, in my last post, you can see the traffic on the 10G NIC.
  11. B

    PVE Backup Speed Optimization

    Yea, I misspoke when I said read, the 0 MB/s is on the write side. Nonetheless, I find the 0 baffling as I have no indication that the system cannot do much better than this, so if you can propose a test or troubleshooting step that would be appreciated. I try DD below with good results. But...
  12. B

    [SOLVED] Dual NIC questions

    So, that output isn't showing me the route - I thought that it was, in fact, showing me the routing via each bridge being used on the host? Anyway, traceroute result is below, and it doesn't show the interface that's being used. But I don't understand your comment about traffic not being able...
  13. B

    [SOLVED] Dual NIC questions

    @LnxBil - Thanks, I wasn't sure how it was handled when the Host has dual NICs. Like I mentioned above, it looks like it's routing to the NIC properly, but since my switch (UniFI XG-16) can't do L3 routing, and my router only has 1 10G (router-on-a-stick) I would like to confirm it's not going...
  14. B

    PVE Backup Speed Optimization

    @LnxBil - Well, I would disagree that 100MB/s is fast - with my 10G network I would expect at least double that, maybe better... But, maybe I'm looking at the wrong thing. It's not at all clear why I would see this asymmetry. The Images are stored on this same SAN network as the backups are...
  15. B

    PVE Backup Speed Optimization

    Another tidbit, I'm not sure why the VM above (NextCloud) was so slow, but this guacamole (Apache VNC) VM is getting 10G directly to the FreeNAS box, crossing the 101<->102 subnets. (192.168.100.124->192.168.101.104) bferrell@freshguac:~$ iperf3 -c 192.168.101.104 Connecting to host...
  16. B

    PVE Backup Speed Optimization

    Thanks, but my understanding is that pigz only comes into play if you pick gzip compression, but I've selected no compression or lzo/FAST. Nonetheless, I have tried the pigz configuration, just to be sure, and it does not affect my speed. No compression is a little faster, but not much. I...
  17. B

    [SOLVED] Dual NIC questions

    Can anyone confirm that this is fine for routing to my storage LAN (192.168.101.0/24), and that I don't need to add any routing commands?
  18. B

    PVE Backup Speed Optimization

    Nobody has any ideas, nor better performance? I see that "improve backups" is on the roadmap, so maybe that'll help?
  19. B

    PVE Backup Speed Optimization

    Update - OK, the FreeNAS NFS share can do at least a sustained 200MB/s read - again, this is a guest VM mapped to the NFS share on FreeNAS reading at over 200, so why can't backups do at least this well? Also, here's iperf3 from the guest VM (Ubuntu 16.04 Plex server) to one of the FreeNAS...
  20. B

    PVE Backup Speed Optimization

    Here's another piece of data. This is to a SMB share on the FreeNAS, but it shows the server can feed the data to a guest VM. My Mac can copy to this share at nearly 500MB/s. I'll try to map the NFS share to see what it's theoretical performance limit is.