passthrough raid 1 hdds to synology without formatting old data.

Ezanity

New Member
Feb 11, 2024
2
0
1
so today i turned on my proxmox and tried to start my synology vm but i was greeted by thhis error message:-

"kvm: -drive file=/dev/disk/by-id/ata-OOS14000G_0008L5EF,if=none,id=drive-sata1,format=raw,cache=none,aio=io_uring,detect-zeroes=on: Could not open '/dev/disk/by-id/ata-OOS14000G_0008L5EF': No such file or directory
TASK ERROR: start failed: QEMU exited with code 1"

i am new to all this so im not 100 percent what this could be but when i realised i was going to need to format all the drives before adding them to synology i though i best pull them all from the pc and drag the files i wanted to keep via usb and slowly backup each drive to the unit before adding each drive back in. i have a 240gb ssd running proxmox and 2x14tb hdds in raid 1 i think(exact backup of the other 14tb hdd)
along with that i think i had a 4tb hdd plugged in but i dont think i mounted it so im sure the only drives i was using was the 2x14tb and the 240gb ssd drive.
i think i installed the synology to the 240gb ssd drive like proxmox but as i followed a youtube video,many dont make it clear what each step does and just get you to follow along with the setup that works for them.
i am currently trying to go through all the oter hdds and plugging them back in just to see if that works but have little hope.
i also installed another vm with synology which im happy to switch too but i dont really want to loose all the data on the 2x14tb drives so would need a good step by step videos showing how to do that.

If i go to DISKS i can see my 240gb as sda.
i can also see my 14tb hdd drives but there listed as follows.

sdb hard disk partitions 14tb
sdb1 Partition linux_raid_member 8.59gb
sdb2 partition linux_raid_member 2.15gb
sdb3 partition linux _raid_member 13.99tb

what is the easiest solution to fix this.
thank you in advanced
 
"kvm: -drive file=/dev/disk/by-id/ata-OOS14000G_0008L5EF,if=none,id=drive-sata1,format=raw,cache=none,aio=io_uring,detect-zeroes=on: Could not open '/dev/disk/by-id/ata-OOS14000G_0008L5EF': No such file or directory
TASK ERROR: start failed: QEMU exited with code 1"
Sounds like your disk "ata-OOS14000G_0008L5EF" you are trying to passthrough is missing and a VM won't start with a disk defined but not available.
So first I would check if the disk is there: ls -la /dev/disk/by-id
 
Sounds like your disk "ata-OOS14000G_0008L5EF" you are trying to passthrough is missing and a VM won't start with a disk defined but not available.
So first I would check if the disk is there: ls -la /dev/disk/by-id
first i want to thank you for your answer. when i messaged this it was 4:30am here in the uk and i was trying to sus this out since around midnight so tiredness wasnt on my side,also lack of experience of proxmox didnt help either as i though maybe hdd but then i was thinking of that random hdd the i still left connected. my proxmox system is in a 4U rackmount pc and i originally installed all the hdds thinking i could just mount and go but i found the easiest way was to put them into a usb docking station into my main pc and transfer over the nextwork being that im new to proxmox.in doing this i still left all the other hdds installed and just worked transfering some other drives across to the 14tb raid.as i have spent days doing this last night i though i would pull the old drives out and get working on thoses however there in a cage which you have to take out first so rather than disconnect it to get to the hdd screws underneith i just tilted it when under closer inspection this morning i found thats the power lead was was just out but looked to be still connected on 1 of the 14tb drives. plugged it in and shes back up so panic over, however im now worried if something goes wrong i wanna have some experience to be able to recover it so i was going to ask just a few questions so i can be prepared if something is to happen.

1: do i need to keep a raid partition on the same sata cables .example , if i pull all the sata cables do i have to make sure the same sata cables goes back into the same hdds( ie should i number them so i dont make this mistake as i intend on having atleast 6-8hdds in here.

2: if the SSD drive where proxmox and synology vm are installed ever dies. what would i need to do to recover everything. like is there a way to make a backup of proxmox so i can install to a brand new ssd and not have to install everything again. like a ghost image of the full system.

3:if i do loose access to proxmox beyond any way of getting it back up and running and have to start fresh, is there a way i can mount all my data drives so i dont loose any data. or could i pull all the data drives and put them into my dock in my windows pc and drag the files back out(at most im only raiding 2 drives the rest will be single 4tb drives as all my important stuff will be on my 14tb raid and then smaller drives are only for movies etc that i can get again and my dock is a 2 port usb dock so i can put both 14tb drives in together if thats needed.)

4: if i run other vms where i want to access these same files can i do this without loosing data or does it not work like this(example if i wanna try out true nas instead of synology could i still see my files)

The things i want on my proxmox are:-
Nas storage(synology ony cause im kinda useless with coding and stuff and i though having a gui would help keep it easy.i just hope i can figure out how to access my files from my phone from outside my network as it would be handy to have my own cloud backup although not essential as maybe i could use my google cloud for that as i have 100gb and then just backup my google cloud to my nas from within my network.

Windows Vm. mainly to test downloaded programs etc incase of viruses as a while back i got stung with a file that when i clicked on it thinking it was a pdf it was infact a backdoor to a hacker that got access to all my google passwords.

home assistant for smart home.

unifi controller for my network

ubunti for learning linux stuff.

a desktop like heimdall so i can access everything from 1 window

plex which im not sure if i should run from synology or its separate vm or maybe jellyfin

if you can answer any of the questions or point me to some idiot proof instructions/videos that would help i would be most grateful and i just want to say thank you again for helping me out
 
1: do i need to keep a raid partition on the same sata cables .example , if i pull all the sata cables do i have to make sure the same sata cables goes back into the same hdds( ie should i number them so i dont make this mistake as i intend on having atleast 6-8hdds in here.
Depends. If you only work with /dev/disk/by-id or UUIDs this wouldn't be a problem. But when working with /dev/sda, /dev/sdb and so on this would be problematic as the enumeration would be in the wrong order.

2: if the SSD drive where proxmox and synology vm are installed ever dies. what would i need to do to recover everything. like is there a way to make a backup of proxmox so i can install to a brand new ssd and not have to install everything again. like a ghost image of the full system.
Nothing official. But you might search for several third-party scripts that backup the config files. I also highly recommend mirroring every disk including the system disk so its no problem when a disk fails.

3:if i do loose access to proxmox beyond any way of getting it back up and running and have to start fresh, is there a way i can mount all my data drives so i dont loose any data.
In general yes. But you should know what you are doing.
or could i pull all the data drives and put them into my dock in my windows pc and drag the files back out(at most im only raiding 2 drives the rest will be single 4tb drives as all my important stuff will be on my 14tb raid and then smaller drives are only for movies etc that i can get again and my dock is a 2 port usb dock so i can put both 14tb drives in together if thats needed.)
PVE is block device centric. So for most stuff you won't find any files you could copy+paste. Especially not using Windows where it might get complicated to work with ZFS, LVM, LVM-Thin, btrfs and so on.
If you care about your data, do proper backups.

4: if i run other vms where i want to access these same files can i do this without loosing data or does it not work like this(example if i wanna try out true nas instead of synology could i still see my files)
Mounting the same virtual disk in two VMs will corrupt the data. So you need to work with NFS/SMB/VirtFS when more than one VM needs to access the same files.