Needed help and forward guidance of the august community on best practice for a potential deployment.
SUMMARY: We have the need for deployment of a Hybrid micro services application. Each single instance deployment has 10 VMs that communicate with each other that is on a separate VLAN.
CRITCAL NEED: An important function is documents management of files both uploaded and generated over time by the application for the user. These files can vary from 200 KB to 1.5 MB per file which can consist of multiple pages. Besides this there are .wav files that are also stored. We want this to be separate from the application instances and reside on separate expandable storage that can be accessed by by multiple application instances.
CURRENT METHOD & PROPOSED MOVE: We currently manage the files via a shared file store VM there is no striping yet. Moving forward we want to move this file store to CEPH on Ubuntu. This will be on separate hardware machines. Need to have the ability to Expand East-West.Objective: Have block, file and object storage needs from a single unified cluster separate from Proxmox that can be accessed by different Instances of the Applications running on Proxmox Cluster.
The ceph storage will have connectivity and communication at 25 GBPS through a dedicated VLAN. The files from the application will be written through the inter-VLAN communication through MELLANOX switch having 100 GBPS Ports.
For Proxmox backups we have currently installed Proxmox Backup Server.
QUERY:
SUMMARY: We have the need for deployment of a Hybrid micro services application. Each single instance deployment has 10 VMs that communicate with each other that is on a separate VLAN.
CRITCAL NEED: An important function is documents management of files both uploaded and generated over time by the application for the user. These files can vary from 200 KB to 1.5 MB per file which can consist of multiple pages. Besides this there are .wav files that are also stored. We want this to be separate from the application instances and reside on separate expandable storage that can be accessed by by multiple application instances.
CURRENT METHOD & PROPOSED MOVE: We currently manage the files via a shared file store VM there is no striping yet. Moving forward we want to move this file store to CEPH on Ubuntu. This will be on separate hardware machines. Need to have the ability to Expand East-West.Objective: Have block, file and object storage needs from a single unified cluster separate from Proxmox that can be accessed by different Instances of the Applications running on Proxmox Cluster.
The ceph storage will have connectivity and communication at 25 GBPS through a dedicated VLAN. The files from the application will be written through the inter-VLAN communication through MELLANOX switch having 100 GBPS Ports.
For Proxmox backups we have currently installed Proxmox Backup Server.
QUERY:
- Is this the right approach or we are missing out on best practice and some critical elements.
- Can we write the files into this storage from the application directly or we should use the Ceph coming with PROXMOXVe.
- What should be points we should keep in mid to ensure compatibility with Proxmox.
- Can we connect the proxmox VMs to write here or we have to handle this separately.
Last edited: