Recent content by cheabred

  1. C

    Ceph with ipv6 saying OSDs are not reachable, but everything works perfect?

    i will say everything seems to work JUST fine even with that error? is this just a proxmox glitch? i can create VM's off the CephFS ios store and write them to the vm store as i only have ceph on this cluster.
  2. C

    Ceph with ipv6 saying OSDs are not reachable, but everything works perfect?

    OK so i have 3 node cluster with 100G mesh network using ipv6 (all the mesh and ipv6 is all working perfectly) but after i add the OSD's from each node im getting this error each node can see eachother no isues fc00::81/128 fc00::82/128 fc00::83/128 the ceph Network is set to fc00::/64...
  3. C

    Mesh Ceph Network with FRR Openfabric - Route question

    OK, coming back because I finally figured out how to get all this working very well. Below are my `frr.conf` and network configuration files, along with some key points about the setup. ### FRR Configuration (`frr.conf`) ip forwarding ipv6 forwarding ! interface ens1f0np0 ip router...
  4. C

    Mesh Ceph Network with FRR Openfabric - Route question

    that is the exact video i found that i followed for the ipv6 and that's how i got it working, not sure why i didn't get ipv4 working, now im working on testing ceph vs starwinds vsan
  5. C

    Mesh Ceph Network with FRR Openfabric - Route question

    I did manage to get it working, not 100% sure why it was not working before, but I switched to ipv6 for the mesh and now it's working perfectly, I'll post the configurations here soon incase anyone wants to know :)
  6. C

    Mesh Ceph Network with FRR Openfabric - Route question

    Here are the 2 FRR configs for those 2 hosts, there are No ip addresses assigned to the interfaces themselves FRR is handling that. i did do an iperf test using the FRR ones, and everything is routing fine, except its an extra hop for some reason tempted to switch to the "Routed Setup...
  7. C

    Mesh Ceph Network with FRR Openfabric - Route question

    Looks like my route setup wants to route over one of the hosts to get to another, even though i have all 3 100G dac cables, attached, it wont direct connect to the other host for some reason? pve1 => .1 pve2 => .2 pve3 => .3 pve1 port1 -> pve2 port 1 pve1 port 2 -> pve3 port 1 pve3 port2 ->...
  8. C

    Web GUI not working after messing with SSL certs

    Ended up fixing it by deleting ssl certs for pveproxy and restarting the service. Not sure why it freaked out but that solved the problem, thank you though!
  9. C

    Web GUI not working after messing with SSL certs

    i was messing around and uploaded my SSL certs, and then restarted the pveproxy like it said to do.. PVE Version pve-manager/5.3-5/97ae681d (running kernel: 4.15.18-9-pve) and now the webGUI is just refusing connection.. ss -tlpn outputs: LISTEN 0 128...
  10. C

    IO Delay 50% or higher on fresh install

    Fresh install on fresh 1TB RAID 10 array this image was from restoring a VM from the local HDD (i only have local drives) that was a < 50GB LZO backup and everything slowed down a LOT, this is a fresh install that i just installed today.. made sure to update everything so its all freshly up...
  11. C

    PVE Daemon failing to start after updating the node V3.1

    edit: remind me to never attempt an update at 5am -_- forgot to restart.
  12. C

    PVE Daemon failing to start after updating the node V3.1

    Tottaly put this in the wrong section :/ sorry about that....... (its 3am and im trying to fix this..) please close. posted in correct section now
  13. C

    PVE Daemon failing to start after updating the node V3.1

    My probably is it had been a long time since i had updated any of the packages on my proxmox server, so i went to update them, and realized that i had to remove the enterprize packed from sources, so i did so, and then apt-get update and apt-get upgrade after it was done downloading and trying...