Yes, Ceph is great!
Just be aware that there may be pitfalls you should know before starting that journey: https://forum.proxmox.com/threads/fabu-can-i-use-ceph-in-a-_very_-small-cluster.159671/
Adding to onslow: qcow2 is a format for vm discs images on file-based storages like directory, nfs, cifs etc. Since this format is restricted to vm images you can achieve snapshots of vms stored on nfs with them but not on lxcs. You could still...
I FIXED IT!!! I had to stop the new node from trying to cluster with systemctl stop pve-cluster then /usr/bin/pmxcfs -l, after this I was able to create the nodes directory and pscp the files from my Windows machine to the new server. After that...
It was a cluster, right? Did you do that on all nodes? If not: start one of the other nodes and use "pmxcfs" local mount to access /etc/pve/nodes/abc/xyz. Remember: cluster configuration is shared between all nodes --> it is/was available on all...
I was facing the same issue! Fixed this by assigning a serial number to the disk.
Get the Disk ID -
ls /dev/disk/by-id
This will return something like ata-WDC_WD5000LMVW-11VEDS0_WD-WX71XXXXXXX34
Now run in Proxmox shell:
qm set 100 -scsi1...
Rotating disks are only usuable for cold storages, especially with ZFS. As mentioned above I would also suggest using enterprise SSD or NVME. Budget friendly models are Samsung PM or Kingston DC drives. SLOG is an option, but for general...
enable ballooning in proxmox for pfsense (even if you not using it), this fix raporting of memory using inside VM. Also install qemu-guest-agent in pfsense (https://forum.netgate.com/topic/162083/pfsense-vm-on-proxmox-qemu-agent-installation this...
Actually I do not understand that question. Usually you assign a virtual disk to a VM. That's it.
These "normal" virtual disks can get migrated to other nodes. (As long we are talking ZFS, which you do.)
(( Passthrough is used if a VM (usual...
Thanks all. I learned some things here.
I've learned fio is a good evaluation tool for the back end disks.
I've learned more about zpool iostat numbers. This is only useful under load.
I've come back to relying on my Atto disk tester...
I'm running SaunaFS on a 3-node PVE cluster plus a PBS server, with 4@8TB Seagate Barracuda DM-SMR SATA drives in each one: I tried Ceph and performance was terrible. Reading around the issue, I now understand that Ceph works best with SSD's. I...
I am not a multi-filesystem expert but more a user/administrator. My very limited but honest opinion is this: reliability, reliability, redundancy, performance, snapshots, compression, encryption. In this order.
Yes, reliability first and...
Hi all,
Leil Storage CEO is here (the company behind SaunaFS). I would like to clarify a few things to you as people who had interest in LFS in the past and may want to know more about directions the project has taken since then.
We hired all...
All officially offered options are valid options: mount it as plain ext4 and create a "Directory storage" or use it for LVM. See https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_storage_types
I am in "Team ZFS", so... I would create a ZFS...
Urmas Rist from Leil Storage (https://leil.io) has ported SaunaFS to Debian and I've installed SaunaFS on my Proxmox cluster using deb packages that I built under Debian 13 (trixie) from sources uploaded by Urmas for a Debian ITP (Itent To...
Yes.
VM/LXC are started in ascending order of vm id if no other order is given at all. If you assign a startup number to a vm, this vm will be started before any other vm without having a startup number assigned. If multiple vm have same startup...
A hint besides the initial question:
BAD IDEA!
Having OS, VM/Container storage AND cache for harddrives inside a VM on ONE NMVe is not going to perform well.
If you still think to try it, go ahead and find out.
Just a quick note for those that might want a walkthrough in written form: https://www.virtualizationhowto.com/2025/11/proxmox-ve-9-1-launches-with-oci-image-support-vtpm-snapshots-and-big-sdn-upgrades/
Hi mason64
That depends. In general yes, you can restore PBS backups to any PVE server. Just add the PBS server as a datastore to your new PVE server. Then you should be able to browse all the existing VM backups and restore them.
Now some...