Search results

  1. L

    [SOLVED] Create a virtual cluster in lxc's?

    Yes, indeed, I'm doing that at the moment. I prefer to use LXC's whenever possible, which it why I gave it a shot...
  2. L

    [SOLVED] Create a virtual cluster in lxc's?

    I actually did install it, and all seems to be installable (using the installation instructions for Proxmox on Debian Bulleye), but corosync doesn't run despite using separate VLAN for the lxc's... I was hoping to that there is a way around whatever the problem is. * corosync.service -...
  3. L

    [SOLVED] Create a virtual cluster in lxc's?

    Hi all, Is it possible to create a virtual proxmox cluster in lxc instances? I'm planning to create a test cluster to experiment with Terraform, so if I can do that in 3 linux containers (create a node in each), it would be the lowest resource usage. Of course I can use full Qemu KVM guests...
  4. L

    [SOLVED] Ceph pool size and OSD data distribution

    I changed the weight of the OSD to be 30% less and that rebalanced the data nicely, so a little manual tuning had the desired effect.
  5. L

    [SOLVED] Ceph pool size and OSD data distribution

    I'm afraid the drive tech of these machines is substantial different. The S1 is a Sunfire X4150 with 2.5" SAS drives, whereas the HP is a ProLiant DL320s G1 with 5.25" SATA drives :-) I'm going to try to adjust the weight of the OSD that's too full to see if I can bring it down that way...
  6. L

    [SOLVED] Ceph pool size and OSD data distribution

    Note: This is more of an effort to understand the system works, than to get support. I know PVE 5 is not supported anymore... I have a 7 node cluster which is complaining that: root@s1:~# ceph -s cluster: id: a6092407-216f-41ff-bccb-9bed78587ac3 health: HEALTH_WARN 1...
  7. L

    [BUG] Network is only working selectively, can't see why

    Would a restart not clear the arp tables anyway? I restarted everything multiple times, and it seemed to make no difference.
  8. L

    Proxmox cloud provider for kubernetes

    I share your sentiment and think PVE should be made "cloud native" as you call it. A great additional, which I have only recently started playing with, is SDN integration into the GUI. To have formal kubernetes support would be really great! As far as auto-creation of clusters is concerned...
  9. L

    [BUG] Network is only working selectively, can't see why

    As with the other issue I could not resolve once I cleaned up the old bridges (how can that be??) and restarted the node, everything came up daisies. For the life of me, I cannot explain it, and I hope I don't have to plough through weeks like this again! o_O:cool:
  10. L

    SDN: To be VLAN aware or not? Or another problem?

    This is weird. I removed the bridge VLAN11 from the SDN and recreate it, then assigned the bridge to the applicable devices and it works. 100% the same as what I had before. This was driving me mad and now it has just numbed me... At least it's working now. Some more feedback: I think this...
  11. L

    SDN: To be VLAN aware or not? Or another problem?

    I have a few vlans set up manually as can be seen from my config here: I have now established that VLAN 35 is actually working 100%, one I set up manually as being eth2.35 but not VLAN aware. Now for the SDN config... I'll compare the generated config with the manual one.
  12. L

    SDN: To be VLAN aware or not? Or another problem?

    After a debug session with NVidia on the Mellanox switch, we have found that the switch is not the culprit and it actually registering the proxmox nic mac addresses and passing the traffic. So it's back to the config of proxmox is seems.
  13. L

    [BUG] Network is only working selectively, can't see why

    I have four nodes with LAN addresses 192.168.131.1, .2, .3 and .4 . These are all configured identically except for the difference of the last octet of an ip address. So NodeA has .1, B has .2, C has .4 and so on. NodeB for example: vmbr0 is the LAN and it's is also the LAN on a pfSense...
  14. L

    SDN: To be VLAN aware or not? Or another problem?

    They can only ping each other when they're on the same node. I corrected myself after posting that in the first message, so apologies if that was not clear. I have since found that there are messages on the switch that say the VLAN is being filtered, so I've taken it up with their tech support.
  15. L

    SDN: To be VLAN aware or not? Or another problem?

    If that was the case, then I would be able to ping at least the host node's address from the windows guest, but I can't. I have now configured an Ubuntu LXC, so test that. The address is 192.168.142.91. If I have the LXC running on the node where the pfSense guest is running, then I can ping...
  16. L

    SDN: To be VLAN aware or not? Or another problem?

    Thanks for that clarification! So I should really just set up a non-VLAN aware Vnet and work with that for now. So maybe I should rephrase my problem then: If I have set up a Vnet and Zone, it creates a bridge tagged with the VLAN. Then, when I add that bridge to a KVM guest machine, the...
  17. L

    SDN: To be VLAN aware or not? Or another problem?

    CORRECTION: On checking this again, here is what I actually get: I can ping the first pfSense VLAN 11 address from any node. (192.168.142.252) I cannot ping the backup pfSense VLAN 11 address from any node, nor from the first pfSense (192.168.142.253) I can ping the CARP virtual IP from any...
  18. L

    SDN: To be VLAN aware or not? Or another problem?

    I'm experimenting with the SDN service and have not been able to figure this one out: If I create a Vnet (in my case 11) and tick "VLAN aware", then I cannot define a subnet. If, on the other hand, I untick "VLAN aware", I can define a subnet. What is the point of this and how does one...
  19. L

    Memory management: ceph

    The beauty of using free/libre software is that one can use it for what one wants. We have a cluster of older repurposed machines that are used as a development and testing environment, be backup to these and it does a great job of it. Surprisingly, the response times are not bad at all. In...
  20. L

    High IO with a lot of LXC Containers

    Just from experience I would think that you should drop one layer of proxmox (I cannot see why you need to run proxmox in a VM inside proxmox when proxmox provides nice features like pools & SDN to keep things separated) and run your you VM with the containers on a proxmox instance that is not...