Poor disk IO performance inside kvm vm on top of DRBD

past

Member
Jun 4, 2010
20
1
23
Moscow, Russia, Russia
Hi all!
We have a very poor performance of file operations inside kvm virtual machines located on the DRBD volume. Installing the service pack for 2008r2 occurs about 20 hours. Anybody can advise in what direction to dig?

pveversion --verbose
pve-manager: 1.7-11 (pve-manager/1.7/5470)
running kernel: 2.6.32-4-pve
proxmox-ve-2.6.32: 1.7-30
pve-kernel-2.6.32-4-pve: 2.6.32-30
qemu-server: 1.1-28
pve-firmware: 1.0-10
libpve-storage-perl: 1.0-16
vncterm: 0.9-2
vzctl: 3.0.24-1pve4
vzdump: 1.2-10
vzprocps: 2.0.11-1dso2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.13.0-3
ksm-control-daemon: 1.0-4

Network config

auto bond0
iface bond0 inet manual
slaves eth0 eth1
bond_mode balance-alb
bond_miimon 100
bond_downdelay 200
bond_updelay 200

auto vmbr0
iface vmbr0 inet static
address 192.168.100.1
netmask 255.255.255.0
gateway 192.168.100.20
bridge_ports bond0
bridge_stp off
bridge_fd 0

drbd config

global { usage-count no; }
common { syncer { rate 50M; } }
resource r0 {
protocol C;
startup {
wfc-timeout 30;
degr-wfc-timeout 120;
outdated-wfc-timeout 2; # 2 seconds.

become-primary-on both;
}
net {
cram-hmac-alg sha1;
shared-secret "mqweqweqweqeqe345345y-secret";
allow-two-primaries;
after-sb-0pri discard-zero-changes;
after-sb-1pri discard-secondary;
after-sb-2pri violently-as0p;
ping-timeout 10; # 500 ms (unit = 0.1 seconds)
sndbuf-size 0;

}
on node1 {
device /dev/drbd0;
disk /dev/cciss/c0d0p3;
address 192.168.100.1:7788;
meta-disk internal;
}
on node2 {
device /dev/drbd0;
disk /dev/cciss/c0d0p3;
address 192.168.100.2:7788;
meta-disk internal;
}
}
 
Hi,
what's about a direct connection between the host? e.g. without bond; eth0 for vmbr0 and eth1 with crossover to eth1 of node2.
As benefit: no latentcy from the switch. Higher mtu possible. With direct connection you also don't need an shared-secret.

I don't know how much effort this bring. My drbd with 1GB-Nic are also not so fast... so i switched to 10GB-Ethernet and on two other machines to dolphinnics.

Udo
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!