[SOLVED] proxmox cluster failed migrate VM

[techdanger]

Dear All,

I have a bit problem here currently we have proxmox cluster , currently can not migrate VM to other nodes.
The copy task are not working at all.Here's the current stat

root@smlpve1:/var/log# pvecm status
Quorum information
------------------
Date: Wed Sep 28 11:59:36 2016
Quorum provider: corosync_votequorum
Nodes: 4
Node ID: 0x00000001
Ring ID: 4/140
Quorate: Yes

Votequorum information
----------------------
Expected votes: 5
Highest expected: 5
Total votes: 4
Quorum: 3
Flags: Quorate

Membership information
----------------------
Nodeid Votes Name
0x00000004 1 192.168.10.40
0x00000001 1 192.168.10.50 (local)
0x00000003 1 192.168.10.110
0x00000002 1 192.168.10.120


root@smlpve1:/var/log# pvecm nodes

Membership information
----------------------
Nodeid Votes Name
4 1 node40
1 1 smlpve1 (local)
3 1 node110
2 1 node120

root@smlpve1:/var/log# pveversion
pve-manager/4.1-22/aca130cf (running kernel: 4.2.6-1-pve)

From one of my node syslog ( node110)
Sep 28 11:46:16 node110 pveproxy[19650]: ipcc_send_rec failed: Transport endpoint is not connected
Sep 28 11:46:16 node110 pveproxy[19651]: ipcc_send_rec failed: Transport endpoint is not connected
Sep 28 11:46:57 node110 pvedaemon[14440]: <root@pam> starting task UPID:node110:00003942:61579918:57EB4B41:qmcreate:117:root@pam:
Sep 28 11:47:16 node110 pvedaemon[14441]: <root@pam> starting task UPID:node110:00003962:6157A09D:57EB4B54:qmigrate:117:root@pam:
Sep 28 11:47:21 node110 pveproxy[19649]: ipcc_send_rec failed: Transport endpoint is not connected
Sep 28 11:47:34 node110 pmxcfs[14459]: [status] notice: received log
Sep 28 11:48:07 node110 pvedaemon[14440]: <root@pam> starting task UPID:node110:000039CD:6157B44F:57EB4B87:qmcreate:117:root@pam:
Sep 28 11:48:28 node110 pvedaemon[14441]: <root@pam> starting task UPID:node110:000039F0:6157BC79:57EB4B9C:qmigrate:117:root@pam:
Sep 28 11:58:07 node110 pmxcfs[14459]: [status] notice: received log
Sep 28 11:58:25 node110 pvedaemon[15640]: destroy VM 117: UPID:node110:00003D18:6158A5DA:57EB4DF1:qmdestroy:117:root@pam:
Sep 28 11:58:25 node110 pvedaemon[14441]: <root@pam> starting task UPID:node110:00003D18:6158A5DA:57EB4DF1:qmdestroy:117:root@pam:

syslog smlpve1 ( node50 )
Sep 28 11:43:33 smlpve1 pveproxy[31499]: ipcc_send_rec failed: Connection refused
Sep 28 11:46:11 smlpve1 pveproxy[31782]: ipcc_send_rec failed: Transport endpoint is not connected
Sep 28 11:59:16 smlpve1 pveproxy[31499]: worker exit
Sep 28 11:59:16 smlpve1 pveproxy[16265]: worker 31499 finished

Here're the screenshot when try to move VM from node110 (192.168.10.110) to smlpve1 ( 192.168.10.50 )



Seem i'm screw my proxmox cluster state, i have restart the service on all nodes ( pvestatd,pvedaemon and pve-cluster ). Kindly help and assistance from all of you.Thank you...

 

[t.lamprecht]

Hi,

The screenshot you provided does not really help to see why exactly the migration failed, can you post the output of the failed migrating task in text form (much easier to handle and read as pictures)

Also, one of your nodes failed or is not online if I see correctly, hows that?

Also what did you do before the cluster state became problematic?

 

[techdanger]

accidentaly shared the storage...after revert now able to migrate the VM to other nodes...