Ceph on proxmox with fibre channell interconnect

gogo3k

New Member
Dec 27, 2014
9
0
1
Hi all, I'am looking on e-bay and I see many cheep fibre channel interfaces with 2/4Gb speed. Now i have 2 servers with proxmox 3.3 and ceph as storage. Each of this servers have 2 aggregated gigabit nic's and it is very slow. It is possible to have fibre channel interconect only to ceph without switch. How i can make this working? How to migrate from ethernet to fibre channell?
 
Hi all, I'am looking on e-bay and I see many cheep fibre channel interfaces with 2/4Gb speed. Now i have 2 servers with proxmox 3.3 and ceph as storage. Each of this servers have 2 aggregated gigabit nic's and it is very slow. It is possible to have fibre channel interconect only to ceph without switch. How i can make this working? How to migrate from ethernet to fibre channell?
Hi,
you can't run IP over FC - perhaps experimental but imho there is no solid solution for that.

And for ceph you need an interconnect. All clients should see the mons and all OSDs on one network.

Udo
 
How i can make this? I use ceph only for rbd storage and all mons and osd's is located on this 2 servers so i think i don't need fc nic's on my clients. In future i'll grow up my rack by adding servers and switch, so 1Gb interfaces are bottleneck.
Sorry for my language and gramatics but its not my native language :)
 
How i can make this? I use ceph only for rbd storage and all mons and osd's is located on this 2 servers so i think i don't need fc nic's on my clients. In future i'll grow up my rack by adding servers and switch, so 1Gb interfaces are bottleneck.
Sorry for my language and gramatics but its not my native language :)

Hi,
with clients I mean qemu-rbd clients - in your case the pve-nodes.

Forget FC-cards for this...

Go for 10GB-Ethernet and if this is too expensive for you take a look on Infiniband cards. Here you also get cheap ones on ebay (10GBit) and you can run IP over IB.
There are also switches available - only the cables are not realy cheap...


Udo