replicating VM without ZFS

[openaspace]

Hi.
I have two host with no zfs...
I can use the pve-sync to sincronyze virtual machines?

https://pve.proxmox.com/wiki/PVE-zsync

Model: ATA HGST HMS5C4040BL (scsi)
Disk /dev/sda: 4001GB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt
Disk Flags: pmbr_boot

Number Start End Size File system Name Flags
5 1049kB 2097kB 1049kB bios_grub
1 2097kB 8592MB 8590MB raid
2 8592MB 9129MB 537MB raid
3 9129MB 1090GB 1081GB raid
4 1090GB 4001GB 2910GB raid


Model: ATA HGST HMS5C4040BL (scsi)
Disk /dev/sdb: 4001GB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt
Disk Flags: pmbr_boot

Number Start End Size File system Name Flags
5 1049kB 2097kB 1049kB bios_grub
1 2097kB 8592MB 8590MB raid
2 8592MB 9129MB 537MB raid
3 9129MB 1090GB 1081GB raid
4 1090GB 4001GB 2910GB raid


Model: ATA HGST HMS5C4040BL (scsi)
Disk /dev/sdc: 4001GB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt
Disk Flags: pmbr_boot

Number Start End Size File system Name Flags
5 1049kB 2097kB 1049kB bios_grub
1 2097kB 8592MB 8590MB raid
2 8592MB 9129MB 537MB raid
3 9129MB 1090GB 1081GB raid
4 1090GB 4001GB 2910GB raid


Model: ATA HGST HMS5C4040BL (scsi)
Disk /dev/sdd: 4001GB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt
Disk Flags: pmbr_boot

Number Start End Size File system Name Flags
5 1049kB 2097kB 1049kB bios_grub
1 2097kB 8592MB 8590MB raid
2 8592MB 9129MB 537MB raid
3 9129MB 1090GB 1081GB raid
4 1090GB 4001GB 2910GB raid


Model: Linux Software RAID Array (md)
Disk /dev/md2: 2162GB
Sector size (logical/physical): 512B/4096B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 2162GB 2162GB ext4


Model: Linux Software RAID Array (md)
Disk /dev/md0: 8580MB
Sector size (logical/physical): 512B/4096B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 8580MB 8580MB linux-swap(v1)


Model: Linux Software RAID Array (md)
Disk /dev/md3: 5821GB
Sector size (logical/physical): 512B/4096B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 5821GB 5821GB ext4


Model: Linux Software RAID Array (md)
Disk /dev/md1: 536MB
Sector size (logical/physical): 512B/4096B
Partition Table: loop
Disk Flags:

Number Start End Size File system Flags
1 0.00B 536MB 536MB ext3

 

[t.lamprecht]

I have two host with no zfs...
I can use the pve-sync to sincronyze virtual machines?

No. pve-zsync only works if both, source and destination, are a ZFS storage.

You can use other common Linux syncing mechanisms, e.g., rsync, if you just want to move some disks/VMs once.

 

[openaspace]

and creating a cluster of two nodes it's not possible to replicate without zfs? or making a ready clone on the second server?

 

[DANILO MONTAGNA]

nd creating a cluster of two nodes it's not possible to replicate without zfs? or making a ready clone on the second server?

No, Storage replication is only supported with ZFS-local storage, anything different from it, is "probably" a shared storage.. so, replication will not be necessary, but you will need to have a good backup/dr strategy!!

 

[t.lamprecht]

and creating a cluster of two nodes it's not possible to replicate without zfs? or making a ready clone on the second server?

Yes, if you make a cluster you can migrate the VMs from one node with local storage, to another node with local storage.

 

[t.lamprecht]

With recent Proxmox VE 6 you can do so over the Webinterface, else you can also use the CLI:

qm migrate VMID TARGETNODE --with-local-disks --targetstorage TARGETSTORAGE-ID

 

[openaspace]

Making a cluster of two nodes (over fiber wan) , there is no possibility to clone a VM from first to second host and be "ready to play" if the first host fail? I mean the vm's available in the pool and in powered off state?
Now with rsync I sync all backup files on the second host, but I need to import.. Modify vm parameters.. and start the vm.

Setting up a continuous rsync of the live vm's is dangerous?

 

[t.lamprecht]

Making a cluster of two nodes (over fiber wan) , there is no possibility to clone a VM from first to second host and be "ready to play" if the first host fail? I mean the vm's available in the pool and in powered off state?

For clustering to work you need latencies of << 10ms, ideally << 5ms (LAN like performance). If your fiber network can do that you should be fine.

You can clone the VM on the source node, and migrate then one of the copies over to the target node.

Now with rsync I sync all backup files on the second host, but I need to import.. Modify vm parameters.. and start the vm.

You can restore a Backup also to a new VM, change some settings and then start it just fine.

Setting up a continuous rsync of the live vm's is dangerous?

Hmm, I'd not suggest it. As long as you just sync over a backup, or ensure that only one VM is started at the same time (avoids address conflicts) it can work, but you have to check quite a few things..

Independent of what you finally want to do, I'd setup a test VM and try out stuff with that one, only once you found a good and working way for what you want to achieve I'd move the real productions VM(s).

 

[openaspace]

Really thank you.
Unfortunately I need to work with raw local disk to have maximum speed, I need to send big video files of 100/200 Gb each over webdav https with average speed of 80 MB/s. The rsync of VM backup files can be enough, it works, and now I run a second rsync inside VM to backup video files inside the raw disk.

The only thing I don't like is that in the main host I have a big 4.99 tb raw disk that I can't backup using integrated proxmox routine because I don't have space and when I restore the vm in the second host it can't find the second associated disk and I need to boot up in rescue mode and delete the string in the fstab and add the local raw disk with files synched previously by rsync.

I can evaluate to create more small raw disk for each client instead unique big disk. Running a freenas vm with nfs inside a raw disk will not change my strategies...

It's possible to use proxmox installing it within an USB key? And take advantage using all internal disks in zfs?

Really Thank you.

 

[openaspace]

It's not possible to compress a raw disk while it is transferred with rsync over ssh without create the lzo local file? And not use local storage? Or make a lzo backup from proxmox directly over wan SFTP?

 

[kappclark]

I have 2 clustered hosts, with the second running zfs...is it possible to migrate vms from LVM box to ZFS box ?? It just occurred to me I may have painted myself in a corner here using 2 different file systems ....

 

[openaspace]

I have 2 clustered hosts, with the second running zfs...is it possible to migrate vms from LVM box to ZFS box ?? It just occurred to me I may have painted myself in a corner here using 2 different file systems ....

I will setup a new server tomorrow with zfs.. i will try, but I think wil be not possible.
Anyway rsync the backup folder to the second server works perfectly, you need only to perform a restore action in the second server and adjust the VM properties if the host hardware have different capabilities .

 

[guletz]

It's not possible to compress a raw disk while it is transferred with rsync over ssh without create the lzo local file? And not use local storage? Or make a lzo backup from proxmox directly over wan SFTP?

Hi,

Maybe you could use a external usb hdd or add a new hdd? In this case you can make on this additional disk/usb a zfs pool. Then you can backup yours VM to it and then use pve-zsync to your remote pmx server.

 

[kappclark]

I will setup a new server tomorrow with zfs.. i will try, but I think wil be not possible.
Anyway rsync the backup folder to the second server works perfectly, you need only to perform a restore action in the second server and adjust the VM properties if the host hardware have different capabilities .

Great advice -- the backup folder is actually located on a NFS share (Freenas) ... I have only done 1 restore, and it worked perfectly...I can sometimes make things too complicated !

 

[openaspace]

Hi,

Maybe you could use a external usb hdd or add a new hdd? In this case you can make on this additional disk/usb a zfs pool. Then you can backup yours VM to it and then use pve-zsync to your remote pmx server.

Hi,
I can't is a remote server in a data center.

Hi,

Maybe you could use a external usb hdd or add a new hdd? In this case you can make on this additional disk/usb a zfs pool. Then you can backup yours VM to it and then use pve-zsync to your remote pmx server.

I think to rent a second server where install freenas without proxmox without internet access and only connection to the vlan of the main host in the datacenter where use directly zfs that replicate data to my local freenas.