Test environment (4 PVE nodes) storage suggestions?

Giovanni

Renowned Member
Apr 1, 2009
112
11
83
Its great to see the advances Proxmox PVE has made since I last tested this software (back when Proxmox VE 1.7). The addition of ZFS support has really sparked my interest back into the project, not to mention the support for Docker containers.

Now, I want to experiment and jump back into PVE and have four test servers:
- (1) very old core 2 duo (does not support virtualization/kvm) - 8gb of ram
- (1) Xeon E3 1220 that does support KVM (currently running esxi) - 16gb of ram
- (2) newer Xeon E5 (6 cores) that does support KVM - 24gb of ram each

All of these servers have single disk drives, I am considering adding more disks and setup proxmox on ZFS (raidz) so it would become somewhat fault-tolerant. The only exception is the very old core 2 duo server (8gb) I will probably leave this server be single disk.

Now I read about the new high availability article for the latest PVE 4.4 and I see a few alternatives for shared storage too (so I can easily start a VM in another node without downtime). http://pve.proxmox.com/wiki/Storage

Which storage option would be recommended for my four servers? I have more than 2 nodes so I could avoid the split brain... I think back in v2.0 there was brtfs experimental (no longer in Storage wiki though) so I thought PVE once had an option to basically copy the disk data from one node to another node using brtfs?

What would be the best performing option? local storage ZFS? is there a recommended network alternative that includes data redundancy split between at least two nodes without sacrificing too much performance?

Has anyone implemented SSD cache log devices on their proxmox setup? Any idea on % performance increase after adding the SSD?

Has anyone experimented or made a single SSD be both the ZIL log as well as L2ARC cache device? any performance improvements or should I stay away from this practice?

Thanks
Giovanni
 
Take a look at pve_zsync. SSDs are commonly used for ZFS, I read from some prople who use it in a PVE envoirenment.
ZIL and ARC on one SSD may lead to problems, it also may work. Best practice would be 2 ssds.

Jonas
 
ZIL drives does not have to be huge, only 5 seconds of sync write are stored here. So, you will only have any benefit for this type of writes.

You need to buy enterprise grade ones like the ones here:
http://www.sebastien-han.fr/blog/20...-if-your-ssd-is-suitable-as-a-journal-device/


And sorry to disappoint you, but docker is not supported on Proxmox VE (but it runs technically, but you cannot manage the docker containers from the GUI). Proxmox VE however supports Linux Containers (LXC).

You old machines can only be used for LXC, emulating KVM is very slow.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!