401 : invalid ticket

  • Thread starter Thread starter Deleted member 53151
  • Start date Start date
D

Deleted member 53151

Guest
Hi,

the last few weeks i've been experimenting with proxmox and ceph in my homelab.
when i tried to login this morning, i kept getting 401: invalid ticket.

what i've already tried;

- use edge instead of firefox
- clear browrser cookies
- regenerated certs, using pvecm updatecerts
- reset system time on both nodes
- checked the md5sum of /etc/pve/authkey.pub

the problem seems no persist across browsers and clients, so i think its something serverside

logs:

PveProxy/acces.log
Code:
192.168.1.18 - - [14/01/2018:17:12:19 +0100] "POST /api2/extjs/access/ticket HTTP/1.1" 200 665
192.168.1.18 - - [14/01/2018:17:12:19 +0100] "GET /api2/extjs/nodes/localhost/subscription?_dc=1515946338653 HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:12:19 +0100] "GET /api2/extjs/version?_dc=1515946338652 HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:12:19 +0100] "GET /api2/json/cluster/resources HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:12:22 +0100] "GET /api2/json/access/domains HTTP/1.1" 200 159
192.168.1.18 - - [14/01/2018:17:28:37 +0100] "POST /api2/extjs/access/ticket HTTP/1.1" 200 662
192.168.1.18 - - [14/01/2018:17:28:37 +0100] "GET /api2/extjs/version?_dc=1515947317203 HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:28:37 +0100] "GET /api2/json/cluster/resources HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:28:37 +0100] "GET /api2/extjs/nodes/localhost/subscription?_dc=1515947317204 HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:28:41 +0100] "GET /api2/json/access/domains HTTP/1.1" 200 159
192.168.1.18 - - [14/01/2018:17:28:41 +0100] "GET /api2/json/cluster/tasks HTTP/1.1" 401 -
192.168.1.18 - - [14/01/2018:17:28:44 +0100] "GET /api2/json/cluster/resources HTTP/1.1" 401 -

daemon.log
Code:
Jan 14 17:27:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 17:27:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 17:28:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 17:28:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 17:29:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 17:29:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 17:30:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 17:30:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 17:31:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...

syslog: yggdrasil
Code:
root@Yggdrasil:/var/log# tail -f /var/log/syslog
Jan 14 18:04:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:04:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:05:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:05:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:06:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:06:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:07:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:07:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:08:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:08:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:09:00 Yggdrasil systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:09:00 Yggdrasil systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:09:01 Yggdrasil pvedaemon[7790]: <root@pam> successful auth for user 'ronald245@pve'

syslog: nidavelliir
Code:
root@Nidavellir:~# tail -f /var/log/syslog
Jan 14 18:04:44 Nidavellir systemd[18119]: Startup finished in 8ms.
Jan 14 18:04:44 Nidavellir systemd[1]: Started User Manager for UID 0.
Jan 14 18:05:00 Nidavellir systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:05:00 Nidavellir systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:06:00 Nidavellir systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:06:00 Nidavellir systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:07:00 Nidavellir systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:07:00 Nidavellir systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:08:00 Nidavellir systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:08:00 Nidavellir systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:09:00 Nidavellir systemd[1]: Starting Proxmox VE replication runner...
Jan 14 18:09:00 Nidavellir systemd[1]: Started Proxmox VE replication runner.
Jan 14 18:09:01 Nidavellir pmxcfs[1657]: [status] notice: received log

pveversion
Code:
root@Yggdrasil:/var/log# pveversion -v
proxmox-ve: not correctly installed (running kernel: 4.13.13-2-pve)
pve-manager: 5.1-42 (running version: 5.1-42/724a6cb3)
pve-kernel-4.13.13-2-pve: 4.13.13-33
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-19
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-16
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9
ceph: 12.2.2-pve1

pvecm nodes
Code:
Membership information
----------------------
    Nodeid      Votes Name
         1          1 Yggdrasil (local)
         2          1 Nidavellir

df -h : Yggdrasil
Code:
Filesystem            Size  Used Avail Use% Mounted on
udev                   24G     0   24G   0% /dev
tmpfs                 4.8G  9.9M  4.8G   1% /run
/dev/mapper/pve-root   94G  2.6G   87G   3% /
tmpfs                  24G   60M   24G   1% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
tmpfs                  24G     0   24G   0% /sys/fs/cgroup
/dev/sda2             253M  288K  252M   1% /boot/efi
/dev/fuse              30M   28K   30M   1% /etc/pve
/dev/sdc1              94M  5.5M   89M   6% /var/lib/ceph/osd/ceph-0
/dev/sdd1              94M  5.5M   89M   6% /var/lib/ceph/osd/ceph-2
tmpfs                 4.8G     0  4.8G   0% /run/user/0

df -h : Nidavellir:
Code:
Filesystem            Size  Used Avail Use% Mounted on
udev                  1.9G     0  1.9G   0% /dev
tmpfs                 392M  5.9M  386M   2% /run
/dev/mapper/pve-root   69G  2.2G   63G   4% /
tmpfs                 2.0G   60M  1.9G   4% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
tmpfs                 2.0G     0  2.0G   0% /sys/fs/cgroup
/dev/fuse              30M   28K   30M   1% /etc/pve
tmpfs                 392M     0  392M   0% /run/user/0

PveProxy start - Debug
Code:
root@Yggdrasil:/var/log#  pveproxy start --debug
3060: ACCEPT FH10 CONN1
close connection AnyEvent::Handle=HASH(0x5641d9613590)
3060: CLOSE FH10 CONN0
3060: ACCEPT FH10 CONN1
3060: ACCEPT FH12 CONN2
3060: ACCEPT FH14 CONN3
close connection AnyEvent::Handle=HASH(0x5641d9f9a298)
3060: CLOSE FH10 CONN2
close connection AnyEvent::Handle=HASH(0x5641da050770)
3060: CLOSE FH12 CONN1
close connection AnyEvent::Handle=HASH(0x5641da061530)
3060: CLOSE FH14 CONN0
3060: ACCEPT FH10 CONN1
close connection AnyEvent::Handle=HASH(0x5641da02bc80)
3060: CLOSE FH10 CONN0
3060: ACCEPT FH10 CONN1
3060: ACCEPT FH12 CONN2
close connection AnyEvent::Handle=HASH(0x5641da050968)
3060: CLOSE FH12 CONN1
3060: ACCEPT FH12 CONN2
3060: ACCEPT FH14 CONN3
close connection AnyEvent::Handle=HASH(0x5641d9613620)
3060: CLOSE FH10 CONN2
3060: ACCEPT FH10 CONN3
3061: ACCEPT FH10 CONN1
close connection AnyEvent::Handle=HASH(0x5641d98f8728)
3060: CLOSE FH12 CONN2
close connection AnyEvent::Handle=HASH(0x5641d9b84f38)
3060: CLOSE FH14 CONN1
close connection AnyEvent::Handle=HASH(0x5641d9613590)
3061: CLOSE FH10 CONN0
close connection AnyEvent::Handle=HASH(0x5641da02c7f0)
3060: CLOSE FH10 CONN0

Response headers:

Code:
HTTP/1.1 401 No ticket
Cache-Control: max-age=0
Connection: close
Date: Sun, 14 Jan 2018 18:19:34 GMT
Pragma: no-cache
Server: pve-api-daemon/3.0
Expires: Sun, 14 Jan 2018 18:19:34 GMT
 
Last edited by a moderator: