Search results

  1. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    So I guess you want to teach me I should use an other MTU? is also the value from the guide The time did differ to my local time over 8hours, but how much the difference between all 3 nodes was, I didn't take a look at.
  2. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    your command succeeded as well, this was/is the output: root@pve01:~# ping -M do -s 3972 10.0.0.82 PING 10.0.0.82 (10.0.0.82) 3972(4000) bytes of data. 3980 bytes from 10.0.0.82: icmp_seq=1 ttl=64 time=0.527 ms 3980 bytes from 10.0.0.82: icmp_seq=2 ttl=64 time=0.483 ms 3980 bytes from...
  3. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    Problem solved :) NTP was the issue the whole day.... grrrrr, all monitors up and running, all managers up and running
  4. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    just edited my post above, right now timesync is not working :) will report back. I did tests like ping/ssh from one node to each other, working on all 3 nodes, but this was also the case with @scyto documentation
  5. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    Ok adjusted everything, same problem, now it is done like documentation of your proxmox link. Here for comparison the new frr file: root@pve03:~# cat /etc/frr/frr.conf # default to using syslog. /etc/rsyslog.d/45-frr.conf places the log in # /var/log/frr/frr.log # # Note: # FRR's configuration...
  6. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    followed the guide from @scyto but will try to add the parts that are not mentioned by him to my config now :) just for later comparison, this is my actual frr.conf: root@pve03:~# cat /etc/frr/frr.conf frr version 9.1 frr defaults traditional hostname pve03 no ipv6 forwarding service...
  7. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    that is correct followed the guide from scyto (https://forum.proxmox.com/threads/intel-nuc-13-pro-thunderbolt-ring-network-ceph-cluster.131107/page-5#post-625262), will test with 29
  8. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    @jsterr Ok I setup everything from scratch and have my working thunderbolt network up and running. Unfortunately it leads all to the same error. I installed it with the following commands: pve01 = 10.0.0.81 pve02 = 10.0.0.82 pve03 = 10.0.0.83 pveceph install --repository no-subscription...
  9. N

    Intel Nuc 13 Pro Thunderbolt Ring Network Ceph Cluster

    Ok now I have the problem with CEPH :/ Installed the reef version as it is the latest one. root@pve03:~# pveceph mon create --mon-address 10.0.0.83 monmaptool: monmap file /tmp/monmap epoch 2 fsid bfe7330e-54a8-47e7-9fff-9a0fe263d43b last_changed 2024-01-17T17:40:07.141415+0100 created...
  10. N

    Intel Nuc 13 Pro Thunderbolt Ring Network Ceph Cluster

    something I noticed during my tests with the FRR configuration (maybe you could add this to your guide?) I tryed just starting with a complete empty /etc/frr/frr.conf and restarted the service afterwards and checked if nothing was added by the daemon itself (it was still empty) then I take a...
  11. N

    Intel Nuc 13 Pro Thunderbolt Ring Network Ceph Cluster

    Hi Scyto, this is already my 2nd attempt to get it up and running. Last time I tried it with IPv6 now I try the IPv4 route. Here are all the answers to your questions, but first of all: thank you for your awesome work! 1. yes a real INTEL NUC not one from an other manufacturer (here the output...
  12. N

    Intel Nuc 13 Pro Thunderbolt Ring Network Ceph Cluster

    Hey guys, just hope someone can help here. I followed the gist to the end and ended up with a 3 node cluster (NUC 13 pro) that is having a working connection after the 'vtysh -c "show openfabric topology"' was done the first time. I see 10.0.0.81, 82 and 83 there on any node. If I reboot one...
  13. N

    Ceph Cluster, can't create 2nd/3rd Monitor/Manager

    Hey guys, I have setup my new thunderbolt 4 cluster that can connect to each other over the Thunderbolt 4 cables. (SSH to each of the others from each other tested f.e., also iperf ping etc.). Unfortunately I'm trying hard to get my Ceph up and running, I always run into timeouts on creating...
  14. N

    USB Device keeps disconnecting

    If I remember right, it was the mainboard or something hardware related to my PC from minisforum. But 2 years have past… I’m not 100% sure! Bought a new conbee stick and other mini PC to run my small homelab and never got and issue again. Sry that I can’t help you really with this answer :/
  15. N

    Question for HA Cluster Networks (Ceph, PVEcm)

    Hey guys, I recently bought 3 Intel NUC 13th gen mini PCs that have 1 M2 and 1 M2-Bkey SATA inside. Unfortunately they lack of mutiple LAN ports. I plan on using CEPH on those 3 devices with the NVMe M2 SSDs. The OS should be installed on the M2 B-Key SATA drive. So I read through the forum /...
  16. N

    Proxmox Votes from QDevice sometimes 0?

    Hi "Max", I followed the instructions exactly, I restarted the Raspberry yesterday and since then it is running again... I guess the service was "broken", but I keep an eye on it next time it is 0 again.
  17. N

    Proxmox Votes from QDevice sometimes 0?

    Hey there, I have a QDevice that seems to not vote from time to time, how can I fix this? Yes the raspberry Pi is running and the service as well on this device.
  18. N

    No Route to host, no DNS taken from WebUI

    Ok first thing is solved now... just found out that the host I was trying to ping got only a subnet /29 instead of the correct /28.... The problem with the DNS still exists, maybe you can help with that? :)
  19. N

    No Route to host, no DNS taken from WebUI

    First thank you for taking a bit of your time for my issue. Here is what you wanted: /etc/resolv.conf root@gateway:~# cat /etc/resolv.conf search mydomain.local nameserver 10.0.42.2 nameserver 10.0.42.3 pct config 47007 root@gateway:~# pct config 47007 arch: amd64 cores: 4 hostname: testLXC...
  20. N

    No Route to host, no DNS taken from WebUI

    Hey Guys, i have setup a new LXC with Ubuntu 22.04. My host is setup to use my adguard as its DNS server. All other LXCs should use exactly the hosts settings for DNS. you guessed it, the /etc/resolv.conf is showing the gateways IP instead for the nameserver. Tested this on 3 other test LXC...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!