Playground time - virtual PBS with iSCSI Backend

[iprigger]

Hi All,

Anyone here played with PBS as a VM and having the data store put onto a iSCSI Target?

Tobias

 

[zenopka]

Funny you brought this up. I just set this up earlier in the week to try out at home.

My setup under PVE 6.3-3:

• VM1: TrueNAS Core
  • RAIDZ2 pool with a dedicated HBA and hard drives.
  • iSCSI share on a dataset with thin provisioning and compression enabled
• VM2: Proxmox Backup Server
• VM....: Various other VM, servers, gaming machines, etc.

So far it's been doing backups regularly in the week and working. I'd like to keep an eye on this setup and see if it works well for a longer period. It would be good to know if anyone else does this and whether or not it's a good idea.

Some high level steps of what I did:

Connect the iSCSI target in your PBS server

1. Setup TrueNAS iSCSI share. I created one using the iSCSI wizard, but once setup it should be broadcasting your server for clients to discover.
2. Proxmox Backup Server already has iscsi-tools command line installed on it. You can use it to discover and attach the iSCSI share to PBS. Before doing so edit /etc/iscsi/iscsid.conf so that it automatically connects the iSCSI node when PBS starts up.
   

   node.startup = automatic

3. Run:
   

   iscsiadm --mode discovery --portal YOUR_SERVER_HOST --type sendtargets

   It should output a list of iSCSI targets setup on TrueNAS using IQN notation. For example:
   

   iqn.2021-04.com.example.myserver:myiscsi-drive

4. Make note of the target name from the output. Login using:
   

   iscsiadm -m node --targetname=iqn.2021-04.com.example.myserver:myiscsi-drive --login

   This will login and attach the iSCSI to PBS. It also saves this config so if you setup Step #2 to "automatic" it will use this config to reconnect each startup.
5. Use iscsiadm -m session -P 3to check the status of any iSCSI drives connected. It will also help you see what device file is associated with it. Mine was 'sdb'
   
   
   
   You can also use lsblk to verify this

Mount the iSCSI drive as a datastore

This part I had troubles with, and actually still not sure if it's setup properly. I couldn't do the setup in the web UI so had to rely on CLI tools to format and setup the drive. Refer to the PBS documentation: https://pbs.proxmox.com/docs/

1. Use fdisk /dev/sdx to partition / format your drive. Replace the device letter with yours.
2. Format it using ext4 mkfs.ext4 /dev/sdx1. Again, replace the device letter and number with your own.
3. Mount the device. I chose to put it in /mnt/proxmox-backup but perhaps there is a better place to put it. I noticed that creating a datastore using the web UI will create a folder in /mnt/datastore.
   
   

   mkdir /mnt/proxmox-backup
   mount /dev/sdx1 /mnt/proxmox-backup

4. You'll also want to update your /etc/fstab so this drive is mounted on startup. What is important is the _netdev flag, This will ensure that the network stack is ready to connect the iSCSI drive during boot up.
   

   /dev/sdx1 /mnt/proxmox-backup ext4 _netdev 0 0

5. Finally create the PBS datastore using:
   

   proxmox-backup-manager datastore create backups /mnt/proxmox-backup

   
   

You should then be able to see the datastore in PBS. I couldn't get the iSCSI drive to appear in the "Storage / Disks" and do the setup there.

Add the PBS server as storage in Proxmox VE 6.3+



Again, not sure if this is the right way of setting this up. But hopefully this can get some conversation going. I'd also be interested to know if people have pros and cons with actually utilizing this kind of setup. I don't have much space for physical servers so it really lets me leverage this main VM server I have. I'm curious about the differences of using ZFS or creating LVMs for these datastores.

 

[iamchriswick]

Thank you @zenopka

 

[nmtambalika]

Thank you @zenopka this was exactly what i was looking for to deploy to a QNAP LUN

 

[iprigger]

mkdir /mnt/proxmox-backup
mount /dev/sdx1 /mnt/proxmox-backup

1. You'll also want to update your /etc/fstab so this drive is mounted on startup. What is important is the _netdev flag, This will ensure that the network stack is ready to connect the iSCSI drive during boot up.
   

   /dev/sdx1 /mnt/proxmox-backup ext4 _netdev 0 0

Hi All,

Just as a heads-up: In case you have several iscsi targets (happens to the best ) please use blkid / uuid in /etc/fstab - that way you don't have effects in case the sd-devices get renumbered on reboot.

Tobias

 

[ITT]

Hi All,

Anyone here played with PBS as a VM and having the data store put onto a iSCSI Target?

Tobias

Yes.

 

[GammaB0blin]

I just created an account, to say thank you zenopka
You made this so easy. I've been clicking around for hours.

 

[MatthewLXJ]

Thank you, helped me a lot

 

[Nips]

Worked for me - Thank you

 

[w0tch3r]

I just want to say. Thank you very much @zenopka. After three days I got it finally to work.

 

[fabfianda]

Thank you @zenopka !!

 

[voyager529]

Hey there @zenopka , I created an account explicitly to say 'thank you' for this post. To expound on this, your steps pointed me in the right direction for using an NFS Mount as a datastore in PBS!

Thank you so much for the insight!

 

[spetrillo]

I am having trouble mounting the storage to my PVE server. Could someone let me know how to do this in the GUI?

 

[iprigger]

I am having trouble mounting the storage to my PVE server. Could someone let me know how to do this in the GUI?

Hi

In case you are using iSCSI you have to mount it by hand (fstab) and then create a directory. The iSCSI Disk is NOT shown in the GUI.

Don't forget to mount it with the _netdev option....

Tobias

 

[orionus]

@zenopka I'm using Proxmox 8.2 and Proxmox Backup Server 3.1 in 2024. The guide still works like a charm. Thank you!