using USB Hard drive to store backups

[Manny Vazquez]

Hi,

I have attached a drive to one of my hosts (VM4), and formatted it ext4, and mounted to /mnt/external



I also added this to the storage


and enabled all the options

Now I can see it from all the hosts

And even backups seem to be working fine, in all the 3 hosts




My question is, if I reformat one of the hosts, (in order to do a clean version update to 5.2), how can I make sure I will be able to see these backups when I can not see the content across the hosts now?
I other words, I can see the content of /mnt/external from each one of the hosts, via console, but I can not see the files of the other hosts..


If I have done something wrong, I am ok with starting over, just need to make sure I can see ALL the lzo files so I can restore the VMs in the NEWLY installed hosts after installing fresh the new version.

 

[fireon]

This drive is only available on host VM4. Because it is a phy device not shared with other members of the cluster. The space what you see on the other hosts is only the local available rootspace. So you see on each host only his own backupfiles.

What can you do? You can mount this external drive on VM4, export it es NFS/Samba and add this share do your Cluster/Storage Configuration.

So the reason why you can't see the files on the new installed host is, they were on the rootfilesystem, and after you installed the node fresh with the ISO, they were deleted.

Here are us USB-Autmountpackages: https://forum.proxmox.com/threads/usb-automount.39296/

 

[Manny Vazquez]

This drive is only available on host VM4. Because it is a phy device not shared with other members of the cluster. The space what you see on the other hosts is only the local available rootspace. So you see on each host only his own backupfiles.

What can you do? You can mount this external drive on VM4, export it es NFS/Samba and add this share do your Cluster/Storage Configuration.

So the reason why you can't see the files on the new installed host is, they were on the rootfilesystem, and after you installed the node fresh with the ISO, they were deleted.

Here are us USB-Autmountpackages: https://forum.proxmox.com/threads/usb-automount.39296/

That makes a lot of sense and it is exactly what I was afraid of. That's why I had not formatted yet.
would the proper procedure be?
1: Stop backups to this /mnt/external mount
2: Delete the backups (or scp them to the USB drive directly from terminal?)
3: remove /mnt/external from the cluster
4: unmount the usb drive on vm4
5: Reformat /dev/sdb1 to ntfs ?????
6: follow sharing instructions ..

Thanks

 

[fireon]

1: Stop backups to this /mnt/external mount

OK

2: Delete the backups (or scp them to the USB drive directly from terminal?)

Yes with "cp" or "rsync"

3: remove /mnt/external from the cluster

OK

4: unmount the usb drive on vm4

OK

5: Reformat /dev/sdb1 to ntfs ?????

Why NTFS? Should the backup readable @Windows? Use Ext4.

6: follow sharing instructions ..

OK.

 

[Manny Vazquez]

OK

Yes with "cp" or "rsync"

OK

OK

Why NTFS? Should the backup readable @Windows? Use Ext4.

OK.

Thanks..
I have it in ext4, so I do not think I need to reformat, right?
Now, I have the usb mounted on VM4 at /mnt/external and it is visible from command

Mounted twice to make sure it was ok and right..

But now
I try


I get this.

and of course it get a NotOnline error..

What am I missing?

 

[Manny Vazquez]

Seems like I had a typo on the nfs share config.

I can now see all my backups from all the VMs.



This is the greatest ever ..

One last question, once I reformat the hosts with new proxmox version, will I have any privileges error (on the usb drive)?
(I am going to use same user - root- and same password as it is now)

 

[fireon]

Root work from everywhere. Except you locked root explicit on the nfsexport.

 

[Manny Vazquez]

Root work from everywhere. Except you locked root explicit on the nfsexport.

How / where did I do that?

 

[fireon]

In the nfsexportsfile. For expample:

/v-machines/home        *(acl,async,no_subtree_check,rw,root_squash)

No rootaccess.

 

[Manny Vazquez]

In the nfsexportsfile. For expample:

/v-machines/home        *(acl,async,no_subtree_check,rw,root_squash)

No rootaccess.

changed like this



At this point I can go into any other host, and create a directory (test) into the mounted shared drive


But when I try to run a backup, still get errors
===================================
INFO: starting new backup job: vzdump 102 --mode snapshot --node vm3 --remove 0 --storage usbdrive --compress lzo
ERROR: Backup of VM 102 failed - unable to create temporary directory '/mnt/pve/usbdrive/dump/vzdump-qemu-102-2018_11_11-10_38_09.tmp' at /usr/share/perl5/PVE/VZDump.pm line 842.
INFO: Backup job finished with errors
TASK ERROR: job errors
================================

I tried creating a test text file into the dump directory, but it did not work.


do I have to start by reformatting drive?
======================================
An idea came in..

I have chmod -R 777 the whole mount on the original host (/msn/external, the one sharing) and now I can run backups across all the hosts..
This was just a small stopped vm that was giving me trouble


Thanks.

Do you think I could / should have done something different?

 

[fireon]

Yes thats right. I has to do with ACL's. Please read the manpage about NFS-Server. If you have "rwxr-xr-x" then it works, because read access for the world. If you would lose rootaccess, you must change owner to a normal user and say "rwx------" say 700. This make sense on hosts with ldap and useraccess too. Then root is hasent access anymore with nfsmount.

 

[Manny Vazquez]

Yes thats right. I has to do with ACL's. Please read the manpage about NFS-Server. If you have "rwxr-xr-x" then it works, because read access for the world. If you would lose rootaccess, you must change owner to a normal user and say "rwx------" say 700. This make sense on hosts with ldap and useraccess too. Then root is hasent access anymore with nfsmount.

Thanks.. I am still learning, love this platform, hope I can convince the owner of the company to move all the enviroment to proxmox and away from vmware, so I can put the budget into paying support

 

[fireon]

Thanks.. I am still learning, love this platform, hope I can convince the owner of the company to move all the enviroment to proxmox and away from vmware, so I can put the budget into paying support

Really nice! Good succeed