Search results

  1. R

    ZFS over ISCSI ?

    I run ZFS over iSCSI on FreeNAS 11.1 using these patches: https://github.com/TheGrandWazoo/freenas-proxmox So far it works like a charm. But as @np86 said - no LXC, KVM VMs only.
  2. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    @Catwoolfii: my storage is on production now. It's too late for testing :-/
  3. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    @udotirol: I've tested LIO based storage on Ubuntu 18.04 LTS and FreeNAS based storage on the same hardware: Intel E5-2620 v4, 64 GB RAM, 18 x 4 TB SAS + 2 x 250 GB SSD, 2 x 10 Gbit Ethernet. Maybe it was a matter of better system's tuning - I don't know. It was my first time when I played with...
  4. R

    VLAN with tag above 126 problem

    I've disabled anything with vlan in name: ethtool -k ens15d1 |grep vlan Cannot get device udp-fragmentation-offload settings: Operation not supported rx-vlan-offload: off tx-vlan-offload: off rx-vlan-filter: on [fixed] vlan-challenged: off [fixed] tx-vlan-stag-hw-insert: off...
  5. R

    VLAN with tag above 126 problem

    Bumping @Stoiko Ivanov - any specific offloading feature? I've disabled anything I was able: ethtool -k ens15d1 |grep offload Cannot get device udp-fragmentation-offload settings: Operation not supported tcp-segmentation-offload: off udp-fragmentation-offload: off...
  6. R

    VLAN with tag above 126 problem

    @udo - We use Huawei CE6810 for about $4000 :-) It supports 4k VLANs. VLAN for my storage network (FreeNAS -> Proxmox) is on VLAN 4063. I've found simple workaround of my problem - I receive VLAN 551 on uplink port of the switch and translate it to VLAN 51 which works fine with Proxmox and NIC...
  7. R

    VLAN with tag above 126 problem

    I've cut too much in previous post 03:00.0 Ethernet controller [0200]: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] [15b3:1007] Subsystem: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] [15b3:000c] Kernel driver in use: mlx4_core Kernel modules: mlx4_core Switching...
  8. R

    VLAN with tag above 126 problem

    03:00.0 Ethernet controller [0200]: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] [15b3:1007] Subsystem: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] [15b3:000c] More fun with it: This adapter has got two interfaces: ens15 (I use it as storage network connected to FreNAS...
  9. R

    VLAN with tag above 126 problem

    Looks like this is a network card driver issue. Server has got 2 x 1 Gbit Intel network adapter + Mellanox ConnectX-3 Pro 2 x 10 Gbit network adapter. No issues with running VLAN 551 on Intel cards.
  10. R

    VLAN with tag above 126 problem

    I'm using Proxmox cluster with vlan aware bridge configured. Till now, I've used only low number vlan tags (4-5). But right now I need to run a VM in VLAN 551. I can configure VMs network interface, set tag 551. But that's all I can. No traffic is going out from that VLAN. When I change tag to 4...
  11. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    I've tested Udo's LIO patches from pve-devel and I can say - they work OK, but ZFS on Linux (Ubuntu 18.04 LTS) with ZVOL over iSCSI totally sucks. I've got huge performance issues with ZFS on Linux. HDD benchmarks inside VM resulted in about 120MB/s sequential and random read/writes The same...
  12. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    All features I need work OK. But so far, I run only 1-2 VMs simultaneously. I need to do some more tests running about 50-100 VMs. If that works, I'll say it is production ready on my site and start to migrate from the old XenServer cluster.
  13. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    Progress report: I've configured FreeNAS storage and found it faulting while cloning VMs and booting from virtio SCSI hard drive. So I moved to Ubuntu 18.04 and iSCSI via LIO. First look after patching Proxmox and configuring ZFS pool and iSCSI target - all works smoothly. But closer look...
  14. R

    ZFS over iSCSI No bootable device

    I'm using ZFS over iSCSI on my PVE Cluster. I'm trying to install KVM VM with virtio SCSI drive: boot from ISO (debian 9.4) - OK disk partitioning - OK system installation - OK grub installation - OK But after first reboot, seaBIOS doesn't recognize the hard drive as a bootable device, so I...
  15. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    I've found this: https://forums.servethehome.com/index.php?threads/mellanox-connectx-2-not-supported-on-new-omnios-hcl.7796/ Old topic, but says that here will be no support for Mellanox cards in OmniOS My card (ConnectX-3 Pro) wasn't detected at all. Got too many problems on start with OmniOS...
  16. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    Typical hardware compatibility problems: 1) OmniOS doesn't recognize my SATA drives connected to LSI based RAID controller. Only SAS drives are visible 2) OmniOS doesn't work with my Mellanox 10Gbit network adapter Is FreeNAS better? I don't know. I've patched my cluster with freenas-proxmox...
  17. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    Cool. Now I need to choose between ZFS On Linux and FreeBSD :-) I think, FreeBSD would be a better choice. Are these patches going to be included in Proxmox in near future?
  18. R

    What open source solutions are available to use "ZFS over iSCSI with Proxmox"?

    Bump I've managed to apply ILO patches on my testing virtual environment. Looks like it works - I can create, delete and migrate offline KVM VMs. Great work of Udo Rader !!! Can't test it on running VMs yet, as Virtualbox doesn't allow to run nested virtualization. Right now I'm preparing to...
  19. R

    ZFS: sudden reboot on heavy disk I/O on a RAID10

    Have you got swap on ZFS on proxmox node? Try this: sysctl -w vm.swappiness=0