But people just don't understand that you can have that with CEPH, just try with any enterprise disks and you will see. Yes, for 25node, petabyte cluster you will need all jtreblay says, but for entry level, just plain 10g, with enterprise disks will suffice.
I have a customer, 2.5g, samsung...