ipcc_send_rec failed and unable to access gui

[linuxuser]

Hi,

I installed Proxmox successfully and have installed a 4 node cluster with about 15 vm between them all working great until a couple of weeks ago. When I try and connect to the GUI https://172.17.x.x:8006 it fails to connect. I have updated all the nodes with the latest version.

root@nice:/var/log# pvecm status
Version: 6.2.0
Config Version: 6
Cluster Name: vm-cluster
Cluster Id: 41908
Cluster Member: Yes
Cluster Generation: 49924
Membership state: Cluster-Member
Nodes: 4
Expected votes: 4
Total votes: 4
Node votes: 1
Quorum: 3
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: nice
Node ID: 1
Multicast addresses: 239.192.163.88
Node addresses: 172.17.xx.xx

------

root@nice:/var/log# /etc/init.d/cman start
Starting cluster:
Checking if cluster has been disabled at boot... [ OK ]
Checking Network Manager... [ OK ]
Global setup... [ OK ]
Loading kernel modules... [ OK ]
Mounting configfs... [ OK ]
Starting cman... [ OK ]
Waiting for quorum... [ OK ]
Starting fenced... [ OK ]
Starting dlm_controld... [ OK ]
Tuning DLM kernel config... [ OK ]
Unfencing self... [ OK ]

----


I am seeing the following error in /var/log/syslog


Sep 16 12:26:01 nice /usr/sbin/cron[2320]: (*system*vzdump) CAN'T OPEN SYMLINK (/etc/cron.d/vzdump)
Sep 16 12:26:09 nice pvestatd[2754]: WARNING: ipcc_send_rec failed: Transport endpoint is not connected
Sep 16 12:26:09 nice pvestatd[2754]: WARNING: ipcc_send_rec failed: Connection refused
Sep 16 12:26:09 nice pvestatd[2754]: WARNING: ipcc_send_rec failed: Connection refused
Sep 16 12:26:09 nice pvestatd[2754]: WARNING: ipcc_send_rec failed: Connection refused
Sep 16 12:26:09 nice pvestatd[2754]: WARNING: ipcc_send_rec failed: Connection refused
Sep 16 12:26:09 nice pvestatd[2754]: WARNING: ipcc_send_rec failed: Connection refused
Sep 16 12:26:12 nice pmxcfs[3073]: [status] notice: update cluster info (cluster name vm-cluster, versio$
Sep 16 12:26:12 nice pmxcfs[3073]: [status] notice: node has quorum
Sep 16 12:26:12 nice pmxcfs[3073]: [dcdb] notice: members: 1/3073, 4/2556
Sep 16 12:26:12 nice pmxcfs[3073]: [dcdb] notice: starting data syncronisation
Sep 16 12:26:12 nice pmxcfs[3073]: [dcdb] notice: members: 1/3073, 4/2556
Sep 16 12:26:12 nice pmxcfs[3073]: [dcdb] notice: starting data syncronisation
Sep 16 12:26:12 nice pmxcfs[3073]: [dcdb] notice: received sync request (epoch 1/3073/00000001)


Please can someone assist with this?

Thanks

 

[linuxuser]

Bump, Can anyone help me with this? Does Proxmox only support users with paid subscription? Any reply would be appreciated.
Thanks

 

[linuxuser]

Bump, I am still getting this error. Please can someone help or tell me to go install esx....

 

[dietmar]

Those warnings are quite normal during startup/boot.

What browser/OS do you use? Also clear your browser cache and restart the browser.

 

[linuxuser]

I am currently using windows 7 with IE and chrome. I have cleared the cache and restarted the browser but I still get this issue. I am getting the following errors repeatedly in the syslog
Sep 26 16:44:01 nice /usr/sbin/cron[2337]: (*system*vzdump) CAN'T OPEN SYMLINK (/etc/cron.d/$
Sep 26 16:44:04 nice pvestatd[2727]: WARNING: ipcc_send_rec failed: Connection refused
Sep 26 16:44:04 nice pvestatd[2727]: WARNING: ipcc_send_rec failed: Connection refused
Sep 26 16:44:04 nice pvestatd[2727]: WARNING: ipcc_send_rec failed: Connection refused
Sep 26 16:44:04 nice pvestatd[2727]: WARNING: ipcc_send_rec failed: Connection refused
Sep 26 16:44:04 nice pvestatd[2727]: WARNING: ipcc_send_rec failed: Connection refused
Sep 26 16:44:04 nice pvestatd[2727]: WARNING: ipcc_send_rec failed: Connection refused

Is there anything else i can check or try? I have also tried to restart and update all the nodes.
Thanks

 

[dietmar]

what is the output of

# pvecm status

and

# service pve-cluster restart

 

[linuxuser]

root@nice:~# pvecm status
Version: 6.2.0
Config Version: 6
Cluster Name: vm-cluster
Cluster Id: 41908
Cluster Member: Yes
Cluster Generation: 49964
Membership state: Cluster-Member
Nodes: 4
Expected votes: 4
Total votes: 4
Node votes: 1
Quorum: 3
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: nice
Node ID: 1
Multicast addresses: 239.192.163.88
Node addresses: 172.17.19.###

---

root@nice:~# service pve-cluster restart
Restarting pve cluster filesystem: pve-cluster.
root@nice:~#



Thanks

 

[linuxuser]

Please see output posted and advise. Thanks

 

[linuxuser]

Bump any next step to solve this issue?

 

[dietmar]

Does it help if you restart pvestatd?

# service pvestatd restart

 

[linuxuser]

Does it help if you restart pvestatd?

# service pvestatd restart

No this did not help.

Thanks

 

[dietmar]

What is the output of

# ls -l /etc/pve

 

[linuxuser]

Hi,

root@nice:~# ls -l /etc/pve
total 4
-rw-r----- 1 root www-data 451 May 30 22:37 authkey.pub
-rw-r----- 1 root www-data 379 Jul 25 13:29 cluster.conf
-rw-r----- 1 root www-data 331 Jul 25 13:29 cluster.conf.old
-rw-r----- 1 root www-data 16 May 30 22:35 datacenter.cfg
lrwxr-x--- 1 root www-data 0 Jan 1 1970 local -> nodes/nice
drwxr-x--- 2 root www-data 0 May 30 22:37 nodes
lrwxr-x--- 1 root www-data 0 Jan 1 1970 openvz -> nodes/nice/openvz
drwx------ 2 root www-data 0 May 30 22:37 priv
-rw-r----- 1 root www-data 1350 May 30 22:37 pve-root-ca.pem
-rw-r----- 1 root www-data 1679 May 30 22:37 pve-www.key
lrwxr-x--- 1 root www-data 0 Jan 1 1970 qemu-server -> nodes/nice/qemu-server
-rw-r----- 1 root www-data 45 May 30 22:35 user.cfg
-rw-r----- 1 root www-data 119 May 30 22:37 vzdump.cron

Thanks

 

[dietmar]

And you still get those errors from pvestatd after restarting it?