Server won't boot - /sbin/init issue

[DJFraz]

Hello,

I've been working on this issue for a while now and opted to try the forums. A web and forum search has been unsuccessful in rendering a resolution.

I am running PVE 5.4.106 and am running into the following issue at startup:

run-init: can't execute '/sbin/init': No such file or directory
Target filesystem doesn't have requested /sbin/init
run-init: can't execute '/sbin/init': No such file or directory
run-init: can't execute '/etc/init': No such file or directory
run-init: can't execute '/bin/init': No such file or directory
/bin/sh: 0: can't access tty; job control turned off

The error started with me trying to upgrade the server via apt-get upgrade and I received the following:

dpkg: warning: 'ldconfig' not found in PATH or not executable
dpkg: warning: 'start-stop-daemon' not found in PATH or not executable

After I rebooted the server (had to do a hard reboot as none of the power commands were found in bash).

Any help is appreciated. Thank you.

 

[leesteken]

It sounds like important parts of your filesystem are missing. What does ls -alh / show?

 

[DJFraz]

Here’s what shows

 

[leesteken]

Does /usr/sbin/init point to /lib/systemd/systemd? Does that exists (ls -alh /lib/systemd/systemd)?

 

[DJFraz]

Does /usr/sbin/init point to /lib/systemd/systemd?

No, it did not. I created the symlink for it. I get a little further in the boot, but not much.

Does that exists (ls -alh /lib/systemd/systemd)?

Yes

Here's how far I get now:

https://youtu.be/jl489q2s8II

 

[leesteken]

Sound like stuff is missing. Did you delete /usr/*? Or did you apt-get remove a lot of software? Or is your filesystem just broken? I suggest reinstalling (a newer version that is still supported) and restoring your VMs from backup.

 

[DJFraz]

I have no idea what happened. I had a power outage and my UPS batteries died (hence the flashing icon in the video on it). Powered it back on a couple weeks ago and did an apt-get upgrade and got the failure. The rest came after the hard reboot.

I was hoping it was something simple, but looks like I'll have to hit up the reinstall.

Thanks for the assist.

 

[leesteken]

There are a few reports on this forum on sudden power-loss and ZFS file system or metadata problems. I haven't yet seen a pattern in them. Is your rpool on one or more "consumer" SSDs?