S3 Storage plugin for PVE

[davekempe]

Hey all.
We have put together a storage plugin for S3 storage for PVE.

This comes from us having used a local directory and s3fs (fuse) with mixed results - bad things happen when the S3 storage goes offline, either via a proxy outage or internet outage.

This is for PVE - the use case is really just a central place to store isos and templates across a collection of clusters. S3 seems like a cheap and easy way to have an organisation wide ISO and template store, and this plugin helps with that. Its not for storing vms and not really for backups - use PBS for that with its S3 integration.

Anyway, its brand new, and we have done some testing on AWS and Digital Ocean S3 variants, but we need more testing. Its Open Source, and any feedback is of course welcome:

https://github.com/sol1/proxs3

Hope it helps someone.

I will say the only hack of this plugin is the javascript injection to make the UI work. It would be nice if PVE had an easier way to extend the forms and javascript stuff for storage plugins. (perhaps it does and I missed it!).

Dave

 

[Sviat]

Hi @davekempe,

it's looks pretty good, thank you for sharing.
Is it the same workflow as using PBS for S3 datastore?
Did you have any issues with pvesm and pvestatd during the testing?
What happen with vzdump backups when the cache is not enough?
Could you please clarify in more details about 'javascript injection'?

 

[fabian]

I will say the only hack of this plugin is the javascript injection to make the UI work. It would be nice if PVE had an easier way to extend the forms and javascript stuff for storage plugins. (perhaps it does and I missed it!).

https://lore.proxmox.com/pve-devel/20251121165858.818307-1-m.carrara@proxmox.com/

 

[davekempe]

Hi @davekempe,

it's looks pretty good, thank you for sharing.
Is it the same workflow as using PBS for S3 datastore?
Did you have any issues with pvesm and pvestatd during the testing?
What happen with vzdump backups when the cache is not enough?
Could you please clarify in more details about 'javascript injection'?

Hi - no this is a storage plugin, and nothing like the PBS integration with S3. If you want backups, I would strongly recommend you use PBS and its (much better) S3 implementation.
You need to restart the daemons after some changes - like installs and upgrades. Not sure what you mean by 'issues' tho.
vzdump will fail if the cache isn't big enough. If that cache is on your root filesystem, bad things may happen.
The javascript injection is for lack of the above mailing list post, which I hadn't seen. Basically we sed into the javascript at install time an extra set of JS that gives us the S3 dropdown. Its all in the github source if you want more detail.
I will have another look at the post Fabian mentioned and see where that is up to and what we can do differently.