[SOLVED] Use a 2*10gbit/s Adapter as a BOND/TEAM for both Network and CEPH

[vec0]

Is it possible to configure two Network interfaces as a BOND to be on the same Network?
I imagine it's better for performance & HA vs using only one interafce for each net.

also.. Can I create disks which are bigger than one physical Disk when using ceph?
like a VM which has a disk of 3TB if I have 3*2TB on each of my 3 Hypervisors.

 

[_gabriel]

ceph can saturate the other network, during backup for example

 

[sb-jw]

Can I create disks which are bigger than one physical Disk when using ceph?
like a VM which has a disk of 3TB if I have 3*2TB on each of my 3 Hypervisors.

Yes this is not a problem. However, you cannot store more on the VMs than you have physical space. But that's probably clear. Otherwise, you can also create 10 TB disks.

 

[vec0]

@_gabriel is there a way to tune this? like maxing out at about 80% of possible bandwidth for ceph?

 

[sb-jw]

So I have always only operated my clusters with 2x 10 GbE, CEPH, cluster, backup, external, internal and migration run over it. So far I've never had any problems with it.

Ultimately, it works and isn't a problem if you know what you're doing and you have your network under control. However, it is not recommended and you should be aware of that. An external DDoS attack can force your entire cluster to reboot.

You can't easily limit the bandwidth, if you can't guarantee that there won't be overload, then you should definitely split it up.

 

[bbgeek17]

Is it possible to configure two Network interfaces as a BOND to be on the same Network?
I imagine it's better for performance & HA vs using only one interafce for each net.

A standard LACP bond will only provide more bandwidth if you have multiple clients with sequential IPs, due to IP hashing. You can try Linux bonding with packet hashing, but its more likely that disk and cpu would be your bottleneck, rather than network.

good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox