Hi,
I have two node cluster with proxmox VE 3.4, all going on well but suddenly one node appears red and all vm and containers running inside it grayed but still running and reachable from either internet and node itself. Also no graph data is shown and the red node appears red if I connect to the web ui via the node ip itself. The only strange thing I can notice in syslog are these error messages:
pvedaemon[899977]: ipcc_send_rec failed: Transport endpoint is not connected
pveproxy[1004452]: ipcc_send_rec failed: Connection refused
I do not want to restart the node and I tried this commands:
/etc/init.d/cman restart
/etc/init.d/pvedaemon restart
/etc/init.d/pvestatd restart
/etc/init.d/pve-manager restart
/etc/init.d/pve-cluster restart
all with success, but in the end nothing changed, node still appears red.
Please help me solving this issue.
Thanks in advance
Output of pvecm status
Version: 6.2.0
Config Version: 2
Cluster Name: drf-cluster-0
Cluster Id: 37722
Cluster Member: Yes
Cluster Generation: 872
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: drf-px090-0
Node ID: 2
Multicast addresses: 239.192.147.237
Node addresses: 192.168.0.79
Output of pvesm status:
D-2TB dir 1 1922728840 1174011556 651041608 64.83%
backup-hetzner-5TB-090 dir 1 1342177280000 378595804800 963581475200 28.71%
local dir 1 196943668 150129240 36803576 80.81%
Output of pvecm nodes:
Node Sts Inc Joined Name
1 M 872 2017-09-24 15:34:30 drf-px121-0
2 M 872 2017-09-24 15:34:30 drf-px090-0
I have two node cluster with proxmox VE 3.4, all going on well but suddenly one node appears red and all vm and containers running inside it grayed but still running and reachable from either internet and node itself. Also no graph data is shown and the red node appears red if I connect to the web ui via the node ip itself. The only strange thing I can notice in syslog are these error messages:
pvedaemon[899977]: ipcc_send_rec failed: Transport endpoint is not connected
pveproxy[1004452]: ipcc_send_rec failed: Connection refused
I do not want to restart the node and I tried this commands:
/etc/init.d/cman restart
/etc/init.d/pvedaemon restart
/etc/init.d/pvestatd restart
/etc/init.d/pve-manager restart
/etc/init.d/pve-cluster restart
all with success, but in the end nothing changed, node still appears red.
Please help me solving this issue.
Thanks in advance
Output of pvecm status
Version: 6.2.0
Config Version: 2
Cluster Name: drf-cluster-0
Cluster Id: 37722
Cluster Member: Yes
Cluster Generation: 872
Membership state: Cluster-Member
Nodes: 2
Expected votes: 2
Total votes: 2
Node votes: 1
Quorum: 2
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: drf-px090-0
Node ID: 2
Multicast addresses: 239.192.147.237
Node addresses: 192.168.0.79
Output of pvesm status:
D-2TB dir 1 1922728840 1174011556 651041608 64.83%
backup-hetzner-5TB-090 dir 1 1342177280000 378595804800 963581475200 28.71%
local dir 1 196943668 150129240 36803576 80.81%
Output of pvecm nodes:
Node Sts Inc Joined Name
1 M 872 2017-09-24 15:34:30 drf-px121-0
2 M 872 2017-09-24 15:34:30 drf-px090-0
