Hi,
I'm experiencing a strange openvz issue.
We've been running proxmox for some time now and have 10+ openvz containers running, the containers have ip's from 3 different IP subnets.
Suddenly 2 of the containers have no network connectivity. They both have ip's in the same subnets. All the others are in different subnets and are working normally.
Reasonable to assume the problem is isolated to those IP's.
Traceroute to one of the IP's from outside gets to the hardware node but not to the VPS.
tcpdump on the hardware node sees packets arrive and r3eplies going out for the affected ip's.
tcpdump in the affected CT's sees traffic arriving _and_ leaving for all services on the CT.
A ping on CT get's no replies and there is no way to reach the affected IP's.
tcpdump on both HN and CT sees traffic for the CT at the hardware node but not in the CT.
This is leading me to think that the packets are getting lost in the hardware node somewhere, Is there anything I can do on the hardware node to see where the packets are getting lost.
This is proxmox 3.2, a fresh install not an upgrade. It's up to date :
pveversion -v
proxmox-ve-2.6.32: 3.1-109 (running kernel: 2.6.32-23-pve)
pve-manager: 3.1-3 (running version: 3.1-3/dc0e9b0e)
pve-kernel-2.6.32-23-pve: 2.6.32-109
lvm2: 2.02.98-pve4
clvm: 2.02.98-pve4
corosync-pve: 1.4.5-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.0-1
pve-cluster: 3.0-7
qemu-server: 3.1-1
pve-firmware: 1.0-23
libpve-common-perl: 3.0-6
libpve-access-control: 3.0-6
libpve-storage-perl: 3.0-10
pve-libspice-server1: 0.12.4-1
vncterm: 1.1-4
vzctl: 4.0-1pve3
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 1.4-17
ksm-control-daemon: 1.1-1
glusterfs-client: 3.4.0-2
Default route on the VPS :
Destination Gateway Genmask Flags Metric Ref Use Iface
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 venet0
0.0.0.0 0.0.0.0 0.0.0.0 U 0 0 0 venet0
Routes on the HN are all correct and show the affeted IP's via venet0
This is a vanilla install of proxmox so I haven't made any changes to vz.conf.
At the moment I'm stumped. Any advice appreciated.
-A
I'm experiencing a strange openvz issue.
We've been running proxmox for some time now and have 10+ openvz containers running, the containers have ip's from 3 different IP subnets.
Suddenly 2 of the containers have no network connectivity. They both have ip's in the same subnets. All the others are in different subnets and are working normally.
Reasonable to assume the problem is isolated to those IP's.
Traceroute to one of the IP's from outside gets to the hardware node but not to the VPS.
tcpdump on the hardware node sees packets arrive and r3eplies going out for the affected ip's.
tcpdump in the affected CT's sees traffic arriving _and_ leaving for all services on the CT.
A ping on CT get's no replies and there is no way to reach the affected IP's.
tcpdump on both HN and CT sees traffic for the CT at the hardware node but not in the CT.
This is leading me to think that the packets are getting lost in the hardware node somewhere, Is there anything I can do on the hardware node to see where the packets are getting lost.
This is proxmox 3.2, a fresh install not an upgrade. It's up to date :
pveversion -v
proxmox-ve-2.6.32: 3.1-109 (running kernel: 2.6.32-23-pve)
pve-manager: 3.1-3 (running version: 3.1-3/dc0e9b0e)
pve-kernel-2.6.32-23-pve: 2.6.32-109
lvm2: 2.02.98-pve4
clvm: 2.02.98-pve4
corosync-pve: 1.4.5-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.0-1
pve-cluster: 3.0-7
qemu-server: 3.1-1
pve-firmware: 1.0-23
libpve-common-perl: 3.0-6
libpve-access-control: 3.0-6
libpve-storage-perl: 3.0-10
pve-libspice-server1: 0.12.4-1
vncterm: 1.1-4
vzctl: 4.0-1pve3
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 1.4-17
ksm-control-daemon: 1.1-1
glusterfs-client: 3.4.0-2
Default route on the VPS :
Destination Gateway Genmask Flags Metric Ref Use Iface
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 venet0
0.0.0.0 0.0.0.0 0.0.0.0 U 0 0 0 venet0
Routes on the HN are all correct and show the affeted IP's via venet0
This is a vanilla install of proxmox so I haven't made any changes to vz.conf.
At the moment I'm stumped. Any advice appreciated.
-A