Can't Start VM

[jerim]

I just upgraded to Proxmox 3.

VM 100 started with no issues.
VM 101 won't start.
I click start and it just stays on:

Executing HA start for VM 101
Member KNTCLCN002 trying to enable pvevm:101...

​

I left it running over night and it is still running this morning.
I tried doing it from the command line: qm 101 start
Same results.
I tried: clusvcadm -d pvevm:101
I tried: qm unlock 101
I can find anything in /var/log/cluster/rgmanager.log as in the file is empty.

 

[dietmar]

Any hint in the task log?

 

[jerim]

UPID:KNTCLCN002:0000B7EE:0062F804:520106AA:hastart:101:root@pam: 5201075C unexpected status
UPID:KNTCLCN002:0000B89F:0063558A:5201079A:hastart:101:root@pam: 520107AD unexpected status
UPID:KNTCLCN002:0000BA55:00645A23:52010A35:hastart:101:root@pam: 52010A57 unexpected status
UPID:KNTCLCN002:0000C85E:006CF568:5201203D:hastart:101:root@pam: 52012138 unexpected status
UPID:KNTCLCN002:0000BBF3:00655A7D:52010CC5:hastart:101:root@pam: 52012142 unexpected status

 

[dietmar]

And what is the content of those logs?

 

[jerim]

Executing HA start for VM 101
Member KNTCLCN002 trying to enable pvevm:101...TASK ERROR: command 'clusvcadm -e pvevm:101 -m KNTCLCN002' failed: received interrupt

But that could just be because I canceled the process after a few hours.

 

[dietmar]

Are all node online? What is the output of:

# pvecm status

Maybe fencing is required?

# fence_tool ls

 

[jerim]

I have four nodes. The output of pvecm status:

root@KNTCLCN002:/var/log/pve/tasks/5# pvecm status
Version: 6.2.0
Config Version: 22
Cluster Name: Cluster
Cluster Id: 11316
Cluster Member: Yes
Cluster Generation: 262252
Membership state: Cluster-Member
Nodes: 4
Expected votes: 4
Total votes: 4
Node votes: 1
Quorum: 3
Active subsystems: 7
Flags:
Ports Bound: 0 177
Node name: KNTCLCN002
Node ID: 2
Multicast addresses: 239.192.44.96
Node addresses: 10.89.99.50
root@KNTCLCN002:/var/log/pve/tasks/5#

Output of fence_tool ls:
root@KNTCLCN002:/var/log/pve/tasks/5# fence_tool ls
fence domain
member count 4
victim count 0
victim now 0
master nodeid 2
wait state none
members 1 2 3 4

 

[dietmar]

What kind of storage does the VM use? Everything online?

 

[jerim]

It uses NFS.
The VM is using .raw
Everything is online. I was able to get one 1 VM up.
On the node that the VM is on, I can do 'df -h /mnt/pve/Storage' and it returns:

Filesystem Size Used Avail Use% Mounted on
10.89.99.30:/Storage 1.8T 399G 1.3T 24% /mnt/pve/Storage

/mnt/pve/Storage contains all the files it should.

 

[dietmar]

Please can you post the VM config?

What if you remove it from HA, and try:

# qm start <VMID>