3 host cluster with ceph suggestion

[flexyz]

Hi

I am thinking about converting our current setup to a Proxmox cluster with CEPH.

Current setup :

3 x Dell R720and 2 x Dell compellent SANs (see diskcount below)

Disk count:

06 x SSD 400GB (DELL LB406S) (Write Intensive)
06 x SSD 1600GB (DELL LB1606R) (Mixed use)
24 x NL 1200GB (DELL ST1200MM0007)
12 x NL 3000GB (SEAGATE ST33000650SS)
24 x NL 300GB (SEAGATE ST9300653SS)

The servers have 8x2.5" frontbays, 2xE5-2650, 256GB RAM

What would be the best combo for each host and how much capacity will the ceph cluster give me?

Maybe with 2 x Netgear ProSAFE XS708T and Intel 10 Gigabit Dual Port X540-BT2 I/O

Thanks a million

 

[jeffwadsworth]

Your capacity with CEPH will be determined by the number of disks (osd's) and the number of replica's of the pg's.

 

[flexyz]

Yes I get that, but what would be the optimal config I could do with the hardware I have?

 

[udo]

Hi

I am thinking about converting our current setup to a Proxmox cluster with CEPH.

Current setup :

3 x Dell R720and 2 x Dell compellent SANs (see diskcount below)

Disk count:

06 x SSD 400GB (DELL LB406S) (Write Intensive)
06 x SSD 1600GB (DELL LB1606R) (Mixed use)
24 x NL 1200GB (DELL ST1200MM0007)
12 x NL 3000GB (SEAGATE ST33000650SS)
24 x NL 300GB (SEAGATE ST9300653SS)

The servers have 8x2.5" frontbays, 2xE5-2650, 256GB RAM

What would be the best combo for each host and how much capacity will the ceph cluster give me?

Maybe with 2 x Netgear ProSAFE XS708T and Intel 10 Gigabit Dual Port X540-BT2 I/O

Thanks a million

Hi,
ceph used direct attached hdds - and you can't use 3.5"-hdds inside your server. So you can't use the 3000GB disks.
But the ST1200MM0007 (10K) with SSDs for journal are fine!

Udo

 

[udo]

Hi

I am thinking about converting our current setup to a Proxmox cluster with CEPH.

Current setup :

3 x Dell R720and 2 x Dell compellent SANs (see diskcount below)

Disk count:

06 x SSD 400GB (DELL LB406S) (Write Intensive)
06 x SSD 1600GB (DELL LB1606R) (Mixed use)
24 x NL 1200GB (DELL ST1200MM0007)
12 x NL 3000GB (SEAGATE ST33000650SS)
24 x NL 300GB (SEAGATE ST9300653SS)

The servers have 8x2.5" frontbays, 2xE5-2650, 256GB RAM

What would be the best combo for each host and how much capacity will the ceph cluster give me?

Maybe with 2 x Netgear ProSAFE XS708T and Intel 10 Gigabit Dual Port X540-BT2 I/O

Thanks a million

Hi,
another remark:
if your LB406 is suitable for journaling can you check - look here: https://www.sebastien-han.fr/blog/2...-if-your-ssd-is-suitable-as-a-journal-device/

Depends on your raid-controller (perc h700?) - perhaps you can use write through - or you must create an raid-0 for every disk (lsi crapware).
About the DELL LB1606R - depends on your workload, but I would use SSD with an high DWPD (Drive Writes Per Day) for ceph.

One posibility:
2 * NL 300GB raid-1 (perc or zfs) for system
1 * SSD 400GB for journal
1 * SSD 1600GB for SSD-Pool
4 * NL 1200GB for HDD-Pool

With replica 3 (highly recomendet) you have round 1.4 TB SSD-Pool-Storage (70% use: 980GB) and round 4.2 TB HDD-Pool-Storage (70%: 2.9 TB).
And you have enough disks to speed up the config with further nodes.

Udo