Recent content by Mrt12

  1. M

    ZFS Special VDEV

    By the way, I expanded now to 2x 480GB. I used Kingston DC600ME SSDs. I can recommend them, they are good suited for a special vdev in my opinion.
  2. M

    ZFS Special VDEV

    Will do. Actually I also already practiced how to do that, to know in advance how it works. Will "zpool attach" the replacement disk first, then wait for the resilver. Then "zpool detach" one of the old disks, remove the disk and put a new disk. Then "zpool attach" the new disk again, and wait...
  3. M

    ZFS native encryption: who uses it?

    Hello all, I am using also at home Proxmox for some VMs and stuff, and also have a ZFS storage set up with Samba for my personal files. Works very well and I also have of course a backup, even to an external site. Now I wonder. This year I migrated my datasets over to a encrypted setup, i.e. my...
  4. M

    ZFS Special VDEV

    Hi, thanks for that. Yes I will definitely replace it. I only wonder how urgent it is. Because I have no 400s or even 480s at hand, currently is still holidays and I would need to order the disks first. What happens if my special device gets full? will the pool fail? I hope not?
  5. M

    ZFS Special VDEV

    Hi, On the beginning of 2024, I set up a new storage server for my work using ZFS and Samba on Proxmox. I added to the ZFS pool a "special" vdev, which gives a really good performance when the 40TB (around 50 Million files) of data are backed up, as the file metadata can be analysed very quickly...
  6. M

    Replication job started failing

    *bump* when is this bug being fixed? After each Proxmox Update I need to manually fix the file /usr/share/perl5/PVE/Storage/ZFSPoolPlugin.pm and change the "cmd" from "-Rpv" to "-RpvL". This is because my datasets use the 1M blocksize. I see that this file has been edited recently, it already...
  7. M

    ZFS Snapshots missing?

    Good day, I have renamed a ZFS dataset that contained a lot of snapshots. I just used zfs rename tank/data/mydataset tank/data/newdataset to rename the dataset and it looks like it worked. Also when I list the snapshots using zfs list -t snap, they are still all present, even with the correct...
  8. M

    Replication job started failing

    May I ask what is the status on this? I just discovered the exact same problem. I can confirm that I could fix it by modifying the ZFSPoolPlugin.m as follows: sub volume_export { my ($class, $scfg, $storeid, $fh, $volname, $format, $snapshot, $base_snapshot, $with_snapshots) = @_...
  9. M

    25GbE network capped at 10GbE

    I just tried with iperf and iperf3, i.e. the following versions: iperf version 2.1.8 (12 August 2022) pthreads iperf 3.12 (cJSON 1.7.15) also I tried with parallel threads, the differences are negligible.
  10. M

    25GbE network capped at 10GbE

    Also I should mention that there is a tuning guide for 25 and 40 GbE from Broadcom for Linux. As I have a Broadcom NIC on one side, I tried the Broadcom recommended tunings, and it seems they improve the throughput slightly. I have the following commands in a script that is automatically called...
  11. M

    Samba LXC redundancy

    Okay, I experimented a bit with replication. It somehow works, but not quite: I created a test LXC on my node "pve0" and set up replication to node "pve1". That works fine, as the LXC's attached subvols are successfuly sent over to the other node. However, when I manually then move the LXC to...
  12. M

    Samba LXC redundancy

    Good day, I have the following scenario. I set up a file storage server with SAMBA and LXC. It works absolutely fine. I have now around 8 TB of data on my storage. I use a ZFS dataset for the storage, and a bind mount to the LXC. This works phantastically well. However I now have a new...
  13. M

    25GbE network capped at 10GbE

    Good day, OK I finally solved the issue and have now ~25 GBits! root@pve1:~# iperf3 -c pve0.mw.iap.unibe.ch Connecting to host pve0.mw.iap.unibe.ch, port 5201 [ 5] local 130.92.113.6 port 46716 connected to 130.92.113.5 port 5201 [ ID] Interval Transfer Bitrate Retr...
  14. M

    25GbE network capped at 10GbE

    Hi, yes I have checked with lspci, that my NIC has a PCIe port that has sufficient bandwidth. I checked with dmesg: root@pve1:~# dmesg | grep PCIe ... [ 2.661103] mlx5_core 0000:06:00.0: 63.008 Gb/s available PCIe bandwidth (8.0 GT/s PCIe x8 link) [ 3.179777] mlx5_core 0000:06:00.1...
  15. M

    25GbE network capped at 10GbE

    yes exactly, I also had this idea. However, I tested iperf with all variants: iperf3 (with no options) iperf3 -P 4 iperf3 -P 8 iperf3 -P16 however, the difference between all the variants was nonexistent to negligible. I have my Proxmox connected to a bridge, and the bridge is connected to a...