Search results

  1. S

    How fast is your backup datastore? Benchmark tool

    I'm doing a remote sync now (about 30ms latency 1 Gbps -> 1 Gbps) and getting 18 Mbps, both servers are HDD backed, and there's 20% iowait on the receiving server which to be fair is running a web server, mail server, & database server but the cpu is idling at about 5%. Tried again from backup...
  2. S

    How fast is your backup datastore? Benchmark tool

    Locally I get : ┌───────────────────────────────────┬──────────────────────┐ │ Name │ Value │ ╞═══════════════════════════════════╪══════════════════════╡ │ TLS (maximal backup upload speed) │ 707.85 MB/s (120%) │...
  3. S

    Compression / Encryption and De-duplication

    Thanks that answers nearly everything for me, I'll have to see what the GC performance is like over time. RE: Encryption, I did find that confusing that it showed the fingerprint of the server, had the option to encrypt but I couldn't see the key, an option to download it will be great and...
  4. S

    Compression / Encryption and De-duplication

    Before I discovered this, I ran containers with the data on a separate volume so I could exclude the data volume from normal backup and use restic to backup the data volume. e.g, you have a mysql container which is a few gigs, but 1Tb of mysql data, so you put the data it on a separate volume...
  5. S

    [SOLVED] zfs pool will not mount at reboot (since upgrade to 6)

    I too solved this by force unmounting my rpool-ssd pool, zfs export -f rpool-ssd, then found files in /rpool-ssd, once removed things mounted on boot correctly. Its a bit tricky because proxmox auto mounts things again so I had to be quick, but you can probably stop the auto importer to see...
  6. S

    CPU power throttle back to save energy

    PVE 6.1 My Ryzen 5 3600 does not scale when set to powersave stays at 2Ghz, but is does scale when set to conservative or on demand. Use this to find out available governors. cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors e.g : conservative ondemand userspace powersave...
  7. S

    ZFS, file or block level storage

    I agree with you I was aware that the results were too crazy to be trusted, also when they system is overloaded and iobound performance plummets, maybe you get very different results with SSD, NVMe. I agree test your own workload in practice and see what happens. Maybe someone else has done...
  8. S

    ZFS, file or block level storage

    Take this with a bucket of salt, all sorts of caching / compression may be going on and you may get very different results. Got very different results when the box was unloaded and loaded with other VM's too. These are under 'medium' load, not very scientific I know but with no load I got...
  9. S

    ZFS, file or block level storage

    Ok, I added a /rpool/data as a ZFS vol 'vms'. When I created a VM the file format is 'raw' and you can't change it, its now greyed out, but now snapshots are available. LnxBil, anything I'm missing here? are there still missing features with this setup? I'm using HDD backed files, I'll do...
  10. S

    ZFS: zvol or files

    You can't snapshot if you mount zvols as directory.
  11. S

    ZFS, file or block level storage

    Ok thanks - I see the catch - with ZFS mounted as directory you don't get snapshots... Full details here : https://pve.proxmox.com/wiki/Storage
  12. S

    ZFS, file or block level storage

    At OVH, by default if you choose to install server with ZFS root filesystem, it mounts as a directory, I guess because, if not you would not be able to store anything but vm images + backups. You can see the 5 vm's have 100Gb disks but it only takes up 115Gb on the actual disk.
  13. S

    ZFS, file or block level storage

    Yes you could, but then you can't store ISO images etc. I don't know if there's other advantages / disadvantages performance wise of either option? I'm not arguing, I'm new to all this, just trying to find out how all this works.
  14. S

    ZFS, file or block level storage

    Its 'raw' but its not really raw. It shows as 1Tb in proxmox, but physically on disk because ZFS is set to thin provision the server takes up 18Gb
  15. S

    ZFS, file or block level storage

    Because qcow on ZFS would be double cow?
  16. S

    ZFS, file or block level storage

    Thanks all, I've gone with ZFS filesystem underneath with thin provisioning and then added them as directorys and added vms with raw disks. This provides everything I need, storing backups and iso images, vm's, snapshots, raw files only actually take up the space that's used and performance is good
  17. S

    ZFS, file or block level storage

    1) File device - Add ZFS pool as a directory 2) Block device - Add ZFS pool as type ZFS 2) only allows Image + Container, but are there are performance differences? Thanks!
  18. S

    ZFS, file or block level storage

    I'm using Proxmox 5.4.31 at OVH, and installed using their Proxmox ZFS template. The entire disk is a ZFS filesystem, but it shows as a local directory in the storage panel. I guess this is more flexible since otherwise you can't store ISO images etc, because block devices only allows Disk...