Proxmox zfs used also as Nas samba share

[openaspace]

Hello.
I have recycled old dell t310 with minimum power bios setup, 4ssd zfs raid single parity for proxmox and VPS and 4 mechanical disks for samba share's managed directly at the main host to replace my old and slow Synology Nas.

I would ask if I can move the 2 8tb Nas driver using btrfs on Synology to the dell proxmox, reading at least one disk, erasing one to zfs, copying data from the oldest btrfs and finally erase the latest disk and creating a zfs raid 1 from the disk with the copied data .

Thank you

 

[rason]

Hi, I am not sure if I understand what do you use the disks for. If it's just about the file storage, you can simply format one of the disks to ZFS and copy all the files onto it from the other one. However, if you are using them for hosting VMs on your Synology NAS, it's going to be a bit more challenging as Proxmox VMs. You can find some useful information here: https://pve.proxmox.com/wiki/Migration_of_servers_to_Proxmox_VE

 

[Dunuin]

I would ask if I can move the 2 8tb Nas driver using btrfs on Synology to the dell proxmox, reading at least one disk, erasing one to zfs, copying data from the oldest btrfs and finally erase the latest disk and creating a zfs raid 1 from the disk with the copied data .

Yes, in case that btrfs is a raid1 you could remove one disk, format it with ZFS and then copy all files over. But keep in mind that a ZFS pool shouldn't be filled more than 80%, so the btrfs disk shouldn't be filled with more than 6.4TB. You also get no bit rot protection while doing the transfer, so the smallest error will cause data corruption. And that copy might take some time. If then the btrfs disk fails you lose all the data, so it is risky.
After the transfer would have finished you could checksum and compare all data to be sure the files are identical.
Then you could wipe that disk in the Synology, put it in the PVE server and use the "zpool attach" command to turn your single disk ZFS pool into a mirror.

 

[openaspace]

Thank you to all!

the 40MB/s synology speed compared to the dell 120MB/s it's a liberation to mount video ads directly from the network.
I have create a postgresql container with the blackmagic davinci video project server and a container samba mounting the shared folder on the zfs.

If I mount 10G network card on the DELL and two 1gbps ethernet on the video workstation in bonding mode, I need a switch with bonding support? exist a cheap one with one 10G port and 8ports with 1gbps with bonding support? Thank you!

Liberation!

 

[Dunuin]

If I mount 10G network card on the DELL and two 1gbps ethernet on the video workstation in bonding mode, I need a switch with bonding support? exist a cheap one? Thank you!

You better also get a 10Gbit NIC for the video workstation. Bonding two Gbit NICs won't give you 2Gbit. It is still 2x 1Gbit, so for most applications you are still limited to 1 Gbit for a single host-to-host connection.

 

[openaspace]

You better also get a 10Gbit NIC for the video workstation. Bonding two Gbit NICs won't give you 2Gbit. It is still 2x 1Gbit, so for most applications you are still limited to 1 Gbit for a single host-to-host connection.

money..always more money with no end... ahah

...the mac workstation mount 2 nvme striped software raid and I always create a proxy version of the 4K source files to work fast and after it render from the 4k original files.. for this I was thinking the bonding can be enough..

10G for mac is really expensive

 

[openaspace]

money..always more money with no end... ahah

...the mac workstation mount 2 nvme striped software raid and I always create a proxy version of the 4K source files to work fast and after it render from the 4k original files.. for this I was thinking the bonding can be enough..

10G for mac is really expensive

are two Mac Pro 2010 xeon 2cpu 24gb ram, upgraded with nvme pci express cards and 12G GPU Cards, I'm not sure the investment of the 10G NIC could be a good choice...because the new Mac mini studio M1/2 with 10g nic is the next future workstation to buy

 

[Dunuin]

No mac here and I just bought used 10Gbit FSP+ NIC for 35€ from china and a used DAC cable for 8€
Not sure how you solve it then. But bonding multiple Gbit NICs isn't a good replacement if you want single highspeed connection between your workstation and NAS. But SMB could make use of it when parallelizing the connection using different ports in parallel when using LACP with layer3+4. But I don't know if that will also help with a single big video file or only if you want to transfer a lot of small files.

 

[openaspace]

No mac here and I just bought used 10Gbit FSP+ NIC for 35€ from china and a used DAC cable for 8€
Not sure how you solve it then. But bonding multiple Gbit NICs isn't a good replacement if you want single highspeed connection between your workstation and NAS. But SMB could make use of it when parallelizing the connection using different ports in parallel when using LCAP with layer3+4. But I don't know if that will also help with a single big video file or only if you want to transfer a lot of small files.

https://www.blackmagicdesign.com/products/blackmagiccloudstoremini

Now for remote sync I'm using syngthing container .. but for some reason it create problems to sync small files...

 

[openaspace]

10Gbit FSP+ NIC for 35€

Give me the link

 

[Dunuin]

Its a "MCX311A-XCAT". Looks like they are now more like 50€. Something like this is still a cheap option if you want a 10Gbit connection between two server: https://www.ebay.com/itm/143171161191?hash=item2155aa8c67:g:bLMAAOSwbaxcifg7
In case you need a cable longer than 3 meters it gets a bit more expensive, because you additionally need 2 SFP+ tranceivers and a glasfiber cable (which would be another 60€ or so). There are also some "cheap" managed switches with 4 SFP+ ports, like the JL682A I think I bought new for 170€.

 

[openaspace]

Its a "MCX311A-XCAT". Looks like they are now more like 50€. Something like this is still a cheap option if you want a 10Gbit connection between two server: https://www.ebay.com/itm/143171161191?hash=item2155aa8c67:g:bLMAAOSwbaxcifg7
In case you need a cable longer than 3 meters it gets a bit more expensive, because you additionally need 2 SFP+ tranceivers and a glasfiber cable (which would be another 60€ or so). There are also some "cheap" managed switches with 4 SFP+ ports, like the JL682A I think I bought new for 170€.

For the calbles i work with short cables, i have placed all workstations in a distant closed rack with hdmi and usb 30 meters cables to avoid noise on the working desk. Really thank you.