[SOLVED] Cant login with web interface

dominikp

Member
Aug 28, 2018
36
3
13
39
We using proxmox for some time and all was fine until yesterday. Today there is a problem that i cant login to proxmox server with webgui. I can only with ssh.

Heres some command outputs that may be helpfull

Code:
root@pve:/var/lib/lxc/128# curl -s -k https://localhost:8006 | grep title
    <title>pve - Proxmox Virtual Environment</title>
root@pve:/var/lib/lxc/128# netstat -ltn | grep 8006
tcp        0      0 0.0.0.0:8006            0.0.0.0:*               LISTEN   
root@pve:/var/lib/lxc/128# pvesh get nodes
200 OK
[
   {
      "id" : "node/pve",
      "node" : "pve",
      "ssl_fingerprint" : "59:5D: ... blablabla ... :87:4C:3A",
      "status" : "unknown",
      "type" : "node"
   }
]
root@pve:/var/lib/lxc/128# netstat -apn | grep 8006
tcp        0      0 0.0.0.0:8006            0.0.0.0:*               LISTEN      14075/pveproxy   
root@pve:/var/lib/lxc/128# uname -r
4.15.17-3-pve
root@pve:/var/lib/lxc/128# tail -f /var/log/pveproxy/access.log
10.11.23.89 - - [28/08/2018:09:53:10 +0200] "GET /pve2/ext6/theme-crisp/resources/images/util/splitter/mini-bottom.png HTTP/1.1" 304 -
10.11.23.89 - - [28/08/2018:09:53:11 +0200] "GET /pve2/ext6/theme-crisp/resources/images/tree/arrows.png HTTP/1.1" 304 -
10.11.23.89 - - [28/08/2018:09:53:11 +0200] "GET /pve2/ext6/theme-crisp/resources/images/grid/sort_desc.png HTTP/1.1" 304 -
10.11.23.89 - - [28/08/2018:09:53:11 +0200] "GET /api2/json/access/domains HTTP/1.1" 200 159
10.11.23.89 - - [28/08/2018:09:53:22 +0200] "GET /pve2/ext6/theme-crisp/resources/images/loadmask/loading.gif HTTP/1.1" 304 -
10.11.23.89 - - [28/08/2018:09:53:52 +0200] "POST /api2/extjs/access/ticket HTTP/1.1" 596 -
10.11.23.89 - - [28/08/2018:09:53:52 +0200] "GET /pve2/ext6/theme-crisp/resources/images/tools/tool-sprites.png HTTP/1.1" 304 -
10.11.23.89 - - [28/08/2018:09:53:52 +0200] "GET /pve2/ext6/theme-crisp/resources/images/shared/icon-error.png HTTP/1.1" 304 -
10.11.23.89 - - [28/08/2018:09:56:28 +0200] "POST /api2/extjs/access/ticket HTTP/1.1" 596 -
127.0.0.1 - - [28/08/2018:09:58:27 +0200] "GET / HTTP/1.1" 200 1908
^C
root@pve:/var/lib/lxc/128# pveversion -v
proxmox-ve: 5.2-2 (running kernel: 4.15.17-3-pve)
pve-manager: 5.2-5 (running version: 5.2-5/eb24855a)
pve-kernel-4.15: 5.2-3
pve-kernel-4.13: 5.1-45
pve-kernel-4.15.17-3-pve: 4.15.17-14
pve-kernel-4.15.17-2-pve: 4.15.17-10
pve-kernel-4.13.16-3-pve: 4.13.16-50
pve-kernel-4.13.16-2-pve: 4.13.16-48
pve-kernel-4.13.13-6-pve: 4.13.13-42
pve-kernel-4.13.13-2-pve: 4.13.13-33
corosync: 2.4.2-pve5
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: 1.2-2
libjs-extjs: 6.0.1-2
libpve-access-control: 5.0-8
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-35
libpve-guest-common-perl: 2.0-17
libpve-http-server-perl: 2.0-9
libpve-storage-perl: 5.0-23
libqb0: 1.0.1-1
lvm2: 2.02.168-pve6
lxc-pve: 3.0.0-3
lxcfs: 3.0.0-1
novnc-pve: 1.0.0-1
proxmox-widget-toolkit: 1.0-19
pve-cluster: 5.0-27
pve-container: 2.0-24
pve-docs: 5.2-4
pve-firewall: 3.0-12
pve-firmware: 2.0-4
pve-ha-manager: 2.0-5
pve-i18n: 1.0-6
pve-libspice-server1: 0.12.8-3
pve-qemu-kvm: 2.11.1-5
pve-xtermjs: 1.0-5
qemu-server: 5.0-29
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3
zfsutils-linux: 0.7.9-pve1~bpo9
root@pve:/var/lib/lxc/128# systemctl status pve-manager.service 
● pve-guests.service - PVE guests 
  Loaded: loaded (/lib/systemd/system/pve-guests.service; enabled; vendor preset: enabled) 
  Active: active (exited) since Sat 2018-07-14 19:03:27 CEST; 1 months 14 days ago 
 Process: 14103 ExecStart=/usr/bin/pvesh --nooutput create /nodes/localhost/startall (code=exited, status=0/SUCCESS) 
Main PID: 14103 (code=exited, status=0/SUCCESS) 
   Tasks: 0 (limit: 4915) 
  Memory: 0B 
     CPU: 0 
  CGroup: /system.slice/pve-guests.service 

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.

Date is correct, i did clear browser cache and tried to login in private/incognito mode. Command ...

Code:
service pvestatd restart

... didnt help
 
Last edited:
Hi,

did you try to flash the browser cache?

Can you run the curl command from an extern PC without grep?
 
I cleared browser cache and im getting normal html from curl
Code:
dominik@dominik-admin ~ $ curl -s -k https://myip:8006
<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1, user-scalable=no">
    <title>pve - Proxmox Virtual Environment</title>
    <link rel="icon" sizes="128x128" href="/pve2/images/logo-128.png" />
    <link rel="apple-touch-icon" sizes="128x128" href="/pve2/images/logo-128.png" />
    <link rel="stylesheet" type="text/css" href="/pve2/ext6/theme-crisp/resources/theme-crisp-all.css" />
    <link rel="stylesheet" type="text/css" href="/pve2/ext6/crisp/resources/charts-all.css" />
    <link rel="stylesheet" type="text/css" href="/pve2/fa/css/font-awesome.css" />
    <link rel="stylesheet" type="text/css" href="/pve2/css/ext6-pve.css?ver=5.2-5" />
    
    <script type='text/javascript'>function gettext(buf) { return buf; }</script>
    
    <script type="text/javascript" src="/pve2/ext6/ext-all.js"></script>
    <script type="text/javascript" src="/pve2/ext6/charts.js"></script>
    
    <script type="text/javascript">
    Proxmox = {
        Setup: { auth_cookie_name: 'PVEAuthCookie' },
        UserName: '',
        CSRFPreventionToken: 'null'
    };
    </script>
    <script type="text/javascript" src="/proxmoxlib.js?ver=1.0-19"></script>
    <script type="text/javascript" src="/pve2/js/pvemanagerlib.js?ver=5.2-5"></script>
    <script type="text/javascript" src="/pve2/ext6/locale/locale-en.js"></script>

    <script type="text/javascript">
    if (typeof(PVE) === 'undefined') PVE = {};
    Ext.History.fieldid = 'x-history-field';
    Ext.onReady(function() { Ext.create('PVE.StdWorkspace');});
    </script>

  </head>
  <body>
    <!-- Fields required for history management -->
    <form id="history-form" class="x-hidden">                                                                                                               
    <input type="hidden" id="x-history-field"/>                                                                                                             
    </form>                                                                                                                                                 
  </body>                                                                                                                                                   
</html>
 
It looks like it has something to do with our browser.
Do you have any Browser plugins what can interfere?
 
I tried with Firefox and Opera, both in default states, no additional plugins except Adblock. At first i tried with chrome but i dont want to clear its cache as i have many things remembered on it.
 
You can try to restart the pveproxy.service.
If this does not work I think the next step is you have to monitor f your network traffic.
 
In my case the problem was caused by not responding container. I tried to run openvpn inside it so i added these lines to 128.conf
Code:
lxc.cgroup.devices.allow = c 10:200 rwm
lxc.hook.autodev = sh -c "modprobe tun; cd ${LXC_ROOTFS_MOUNT}/dev; mkdir net; mknod net/tun c 10 200; chmod 0666 net/tun"

... but container didnt start ...

Code:
Job for pve-container@128.service failed because a timeout was exceeded.
See "systemctl status pve-container@128.service" and "journalctl -xe" for details.
TASK ERROR: command 'systemctl start pve-container@128' failed: exit code 1

... and even lxc-ls didnt work. So i followed this guide ...
https://atech.blog/viaduct/identifying-crashed-lxc-containers

... i killed crashed process and i could log in with webgui again. But now i have problem that containers dont start. Similar to this ...
https://forum.proxmox.com/threads/lxc-container-reboot-fails-lxc-becomes-unusable.41264/
 
Last edited:
Thanks for this. Looks like this was my issue as well, mount commands are stuck for some reason on my host OS