Proxmox completely broken - Please help ASAP

C

Cake

New Member
Mar 6, 2017
18
0
1
35
Started off with the panel breaking like this: http://i.md-5.us/YJ24cG.png

root@panel1:/home/customer# systemctl -l status pve-cluster.service
* pve-cluster.service - The Proxmox VE cluster filesystem
Loaded: loaded (/lib/systemd/system/pve-cluster.service; enabled)
Active: failed (Result: exit-code) since Sun 2017-04-02 08:15:13 CDT; 1min 34s ago
Process: 1471 ExecStart=/usr/bin/pmxcfs $DAEMON_OPTS (code=exited, status=255)


root@panel1:/etc/pve# pvecm updatecerts
pve configuration filesystem not mounted
root@panel1:/etc/pve# pmxcfs -f -d
[main] crit: Unable to get local IP address (pmxcfs.c:810:main)
root@panel1:/etc/pve#
 
Cake said:
Plaese help...
Click to expand...
Hi,
how could we help with this amount of information??
The only thing we know is that your pve-cluster service don't run...

To help we need additional infos about your system. Like is it an standard installation, which version, what have you done before it's stop to work?

To make an overview post the output of following commands:
Code: 
df -h
pveversion -v
dpkg -l | grep pve
pvs
vgs
lvs
Udo
 
df -h
Code: 
root@s104497:/proc# df -h
Filesystem      Size  Used Avail Use% Mounted on
udev             10M     0   10M   0% /dev
tmpfs            13G  9.2M   13G   1% /run
/dev/dm-0       422G   27G  374G   7% /
tmpfs            32G     0   32G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            32G     0   32G   0% /sys/fs/cgroup
/dev/sda1       236M   68M  157M  31% /boot

pveversion -v
Code: 
root@s104497:/proc# pveversion -v

proxmox-ve: 4.4-82 (running kernel: 4.4.40-1-pve)
pve-manager: not correctly installed (running version: 4.4-13/7ea56165)
pve-kernel-4.4.40-1-pve: 4.4.40-82
lvm2: 2.02.116-pve3
corosync-pve: 2.4.2-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-109
pve-firmware: 1.1-10
libpve-common-perl: 4.0-92
libpve-access-control: 4.0-23
libpve-storage-perl: 4.0-76
pve-libspice-server1: 0.12.8-2
vncterm: 1.3-1
pve-docs: 4.4-3
pve-qemu-kvm: 2.7.1-4
pve-container: 1.0-94
pve-firewall: 2.0-33
pve-ha-manager: 1.0-40
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.7-3
lxcfs: 2.0.6-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80

dpkg -l | grep pve
Code: 
root@s104497:/proc# dpkg -l | grep pve
ii  corosync-pve                   2.4.2-1                        amd64        Standards-based cluster framework (daemon and modules)
ii  dmeventd                       2:1.02.93-pve3                 amd64        Linux Kernel Device Mapper event daemon
ii  dmsetup                        2:1.02.93-pve3                 amd64        Linux Kernel Device Mapper userspace library
ii  grub-common                    2.02-pve5                      amd64        GRand Unified Bootloader (common files)
ii  grub-pc                        2.02-pve5                      amd64        GRand Unified Bootloader, version 2 (PC/BIOS version)
ii  grub-pc-bin                    2.02-pve5                      amd64        GRand Unified Bootloader, version 2 (PC/BIOS binaries)
ii  grub2-common                   2.02-pve5                      amd64        GRand Unified Bootloader (common files for version 2)
ii  libcorosync4-pve               2.4.2-1                        amd64        Standards-based cluster framework (libraries)
ii  libdevmapper-event1.02.1:amd64 2:1.02.93-pve3                 amd64        Linux Kernel Device Mapper event support library
ii  libdevmapper1.02.1:amd64       2:1.02.93-pve3                 amd64        Linux Kernel Device Mapper userspace library
ii  liblvm2app2.2:amd64            2.02.116-pve3                  amd64        LVM2 application library
ii  liblvm2cmd2.02:amd64           2.02.116-pve3                  amd64        LVM2 command library
ii  libpve-access-control          4.0-23                         amd64        Proxmox VE access control library
ii  libpve-common-perl             4.0-92                         all          Proxmox VE base library
ii  libpve-guest-common-perl       1.0-2                          all          Proxmox VE common guest-related modules
ii  libpve-http-server-perl        1.0-4                          all          Proxmox Asynchrounous HTTP Server Implementation
ii  libpve-storage-perl            4.0-76                         all          Proxmox VE storage management library
ii  lvm2                           2.02.116-pve3                  amd64        Linux Logical Volume Manager
ii  lxc-pve                        2.0.7-3                        amd64        Linux containers usersapce tools
ii  lxcfs                          2.0.6-pve1                     amd64        LXC userspace filesystem
ii  novnc-pve                      0.5-8                          amd64        HTML5 VNC client
ii  pve-cluster                    4.0-48                         amd64        Cluster Infrastructure for Proxmox Virtual Environment
ii  pve-container                  1.0-94                         all          Proxmox VE Container management tool
ii  pve-docs                       4.4-3                          all          Proxmox VE Documentation
ii  pve-firewall                   2.0-33                         amd64        Proxmox VE Firewall
ii  pve-firmware                   1.1-10                         all          Binary firmware code for the pve-kernel
ii  pve-ha-manager                 1.0-40                         amd64        Proxmox VE HA Manager
ii  pve-kernel-4.4.40-1-pve        4.4.40-82                      amd64        The Proxmox PVE Kernel Image
ii  pve-libspice-server1           0.12.8-2                       amd64        SPICE remote display system server library
iF  pve-manager                    4.4-13                         amd64        The Proxmox Virtual Environment
ii  pve-qemu-kvm                   2.7.1-4                        amd64        Full virtualization on x86 hardware
ii  smartmontools                  6.5+svn4324-1~pve80            amd64        control and monitor storage systems using S.M.A.R.T.
ii  tar                            1.27.1+pve.3                   amd64        GNU version of the tar archiving utility

pvs
Code: 
root@s104497:/proc# pvs
  PV         VG         Fmt  Attr PSize   PFree
  /dev/sda5  s104497-vg lvm2 a--  446.89g    0

vgs
Code: 
root@s104497:/proc# vgs
  VG         #PV #LV #SN Attr   VSize   VFree
  s104497-vg   1   2   0 wz--n- 446.89g    0

lvs
Code: 
root@s104497:/proc# lvs
  LV     VG         Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  root   s104497-vg -wi-ao---- 428.78g
  swap_1 s104497-vg -wi-ao----  18.11g
 
Done:

Code: 
Setting up pve-firmware (1.1-11) ...
dpkg: dependency problems prevent configuration of proxmox-ve:
 proxmox-ve depends on pve-manager; however:
  Package pve-manager is not configured yet.
 proxmox-ve depends on qemu-server; however:
  Package qemu-server is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
 dependency problems - leaving unconfigured
Processing triggers for libc-bin (2.19-18+deb8u7) ...
Errors were encountered while processing:
 pve-cluster
 qemu-server
 pve-container
 pve-manager
 proxmox-ve
E: Sub-process /usr/bin/dpkg returned an error code (1)
 
I see:

[main] crit: Unable to get local IP address (pmxcfs.c:810:main)

which usually indicates that /etc/hosts does not have an entry for the local hostname?

But how did you run into that state?
 
udo said:
Hi,
does an
Code: 
apt install pve-manager
work?

Udo
Click to expand...
Code: 
Do you want to continue? [Y/n]
Setting up pve-cluster (4.0-49) ...
Job for pve-cluster.service failed. See 'systemctl status pve-cluster.service' and 'journalctl -xn' for details.
invoke-rc.d: initscript pve-cluster, action "restart" failed.
dpkg: error processing package pve-cluster (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of qemu-server:
 qemu-server depends on pve-cluster; however:
  Package pve-cluster is not configured yet.

dpkg: error processing package qemu-server (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of pve-container:
 pve-container depends on pve-cluster (>= 4.0-8); however:
  Package pve-cluster is not configured yet.

dpkg: error processing package pve-container (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of pve-manager:
 pve-manager depends on qemu-server (>= 1.1-1); however:
  Package qemu-server is not configured yet.
 pve-manager depends on pve-cluster (>= 1.0-29); however:
  Package pve-cluster is not configured yet.
 pve-manager depends on pve-container; however:
  Package pve-container is not configured yet.

dpkg: error processing package pve-manager (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of proxmox-ve:
 proxmox-ve depends on pve-manager; however:
  Package pve-manager is not configured yet.
 proxmox-ve depends on qemu-server; however:
  Package qemu-server is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
 dependency problems - leaving unconfigured
Errors were encountered while processing:
 pve-cluster
 qemu-server
 pve-container
 pve-manager
 proxmox-ve
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@s104497:/proc#
 
dietmar said:
I see:

[main] crit: Unable to get local IP address (pmxcfs.c:810:main)

which usually indicates that /etc/hosts does not have an entry for the local hostname?

But how did you run into that state?
Click to expand...

The server rebooted
 
udo said:
ah,
good point - so i will ask in the future for "cat /etc/hosts" also...

Udo
Click to expand...

Code: 
root@s104497:/proc# cat /etc/hosts
127.0.0.1       localhost

# The following lines are desirable for IPv6 capable hosts
::1     localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
69.197.160.74 s104497.wholesaleinternet.net s104497
 
Cake said:
Code: 
root@s104497:/proc# cat /etc/hosts
127.0.0.1       localhost

# The following lines are desirable for IPv6 capable hosts
::1     localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
69.197.160.74 s104497.wholesaleinternet.net s104497
Click to expand...
Hi,
you missed pvelocalhost!

Code: 
69.197.160.74 s104497.wholesaleinternet.net s104497 pvelocalhost
If you don't have an internal IP…

Udo
 
Hostname:

customer@s104497:~$ cat /etc/hostname
s104497

---

Hosts:

customer@s104497:~$ cat /etc/hosts
127.0.0.1 localhost

# The following lines are desirable for IPv6 capable hosts
::1 localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
69.197.160.74 s104497.wholesaleinternet.net s104497 pvelocalhost
 
Greetings. I'm currently working alongside Cake to fix this issue. Seeing as most of the config files weren't backed up, I was looking into possibly moving the existing containers to another Proxmox VE server via the CLI. Is this at all possible?

Thanks.
-miako
 
<~miako> said:
Greetings. I'm currently working alongside Cake to fix this issue. Seeing as most of the config files weren't backed up, I was looking into possibly moving the existing containers to another Proxmox VE server via the CLI. Is this at all possible?

Thanks.
-miako
Click to expand...
Hi,
why? If you set hostname + pvelocalhost you should be able to configure pve-manger and the apt dist-upgrade should work...

Udo
 
Well, seeing as /etc/pve is completely empty I'm going to have to have a little talk with wholesaleinternet.

Code: 
root@s104497:/etc/pve# ls -la
total 12
drwxr-x---   2 root root 4096 Apr  2 08:18 .
drwxr-xr-x 100 root root 4096 Apr  2 09:01 ..
-rw-r--r--   1 root root    2 Apr  2 08:18 .debug
 
Code: 
root@s104497:/etc/pve# ls -lsa /var/lib/pve-cluster/
total 36
 4 drwxr-xr-x  2 root root  4096 Apr  2 09:56 .
 4 drwxr-xr-x 50 root root  4096 Mar 28 23:23 ..
28 -rw-------  1 root root 28672 Apr  2 08:30 config.db
 0 -rw-------  1 root root     0 Mar  6 20:30 .pmxcfs.lockfile
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back