lousy performance

[Udbytossen]

Hi Forum
Just discovered Proxmox VE - and have installed on a IBM system 3850 X5
I have 4x8C 2000ghz Xeon CPU - and 512GB RAM in it.
I've installed the Proxmox on a RAID1 with zfc filesystem

I have now installed 3 different VM ( 3 x MySQL DB for test enviorment)
BUT i'm experience a lack of performance.
I can sometimes have a machine that won't response with in 5 minutes - But cannot see any problems with the pve performance - and neither on each VM.
I'm experience this each 10minutes ca.

I cannot not imagine this is a missing performance on the IBM server ( I have 2 of those systems - and tried the PVE on both)
Does anybody have an idea for this ? What can I do to make this perform perfect?

My Network I have 2x4 PCI NICS - created an bond on each PCI - and created a bridge to the subnets.
But I am really in doubt on where I can tweak this - Since I do not experience these fallout when I use VMware ESXi on the same server

 

[t.lamprecht]

I can sometimes have a machine that won't response with in 5 minutes - But cannot see any problems with the pve performance - and neither on each VM.
I'm experience this each 10minutes ca.

so periodic, spike performance penalties? In between all seems well?
What types are the disks backing the ZFS?
Also, could you post a VM configuration, e.g., with

qm config VMID

to quickly see if there's something off. Also what's the Distro/OS running in the VM?

If no CPU scheduling or I/O issue is to be found it could be that a periodic (cleanup?) operation from the VM gets in conflict with the VM hypervisor KVM/QEMU..

 

[Udbytossen]

Thanks for the reply.
No spikes etc - all seams well
The DB distros are Debian 9 - with MySQL 8.0.11
The system have 2xsanddisk Extreme 120GB USB ( Mountet internal on Motherboard)
I only have one pve ( so no replication for this - but thats tthge only things that gets my eye)
DB1:

root@pve:~# qm config 102
bootdisk: scsi0
cores: 2
ide2: local:iso/debian-9.8.0-amd64-netinst.iso,media=cdrom,size=292M
memory: 8192
name: db1
net0: virtio=F2:9A:01:F1:26:05,bridge=vmbr1,firewall=1
numa: 0
ostype: l26
scsi0: Machine:vm-102-disk-0,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=0154aeeb-8e1a-4090-a519-3137e18f11e0
sockets: 2
vmgenid: fd5a08b2-a620-4586-aa80-c8547b714125

DB2

root@pve:~# qm config 103
bootdisk: scsi0
cores: 2
ide2: local:iso/debian-9.8.0-amd64-netinst.iso,media=cdrom,size=292M
memory: 8192
name: db2
net0: virtio=0E:87:0D:9E:5F:09,bridge=vmbr1,firewall=1
numa: 0
ostype: l26
scsi0: Machine:vm-103-disk-0,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=2ab918e7-1533-41ee-8c84-e5d6aa5e6b47
sockets: 2
vmgenid: 23fbb783-a2dd-4e68-886b-0145fa9d4fc5

DB3

 qm config 104
bootdisk: scsi0
cores: 2
ide2: local:iso/debian-9.8.0-amd64-netinst.iso,media=cdrom,size=292M
memory: 8192
name: db3
net0: virtio=F2:07:96:56:3C:BA,bridge=vmbr1,firewall=1
numa: 0
ostype: l26
scsi0: Machine:vm-104-disk-0,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=3c81a930-eebf-48c8-bc13-fb8a73cefc1e
sockets: 2
vmgenid: 870a1302-5ec2-4a56-8711-03b8c636b4db

 

[spirit]

Hi,

>>2xsanddisk Extreme 120GB USB

Are you vm on this storage too ?

(because, you'll have bad performance with zfs with this kind of disk. you need fast sync write for zfs)

 

[Udbytossen]

No my VM's is on the internal RAID storage 4x1TB - raid 10

This is Only used as running the Proxmox Machine ( As I did allso with vmware)

 

[janssensm]

No my VM's is on the internal RAID storage 4x1TB - raid 10

This could be the cause, if by internal raid you mean internal raid controller.
Can't make up from your info if you are running zfs on this storage pool for the VM's.
ZFS and raid controllers don't mix well, unless flashed in IT mode.

 

[spirit]

No my VM's is on the internal RAID storage 4x1TB - raid 10

This is Only used as running the Proxmox Machine ( As I did allso with vmware)

So zfs is only for the system , and you don't have any zfs on the raid10 ? (lvm-thin ?).

 

[Udbytossen]

I have 2 x128GB USB disk - set as RAID1 - running zfs --> Proxmox Hypervisor
Then I Have 4x1TB 2,5" WD Red harddisk.
Using onboard RAIDController - this is setup as RAID10 - Running ZFS on this storage!
Well I do only have these discs - No other options - Og how woould you create this setup ( Mostly becarse running VMware is really stable on the same hardware setup )

 

[XMarcR]

Using onboard RAIDController - this is setup as RAID10 - Running ZFS on this storage!

Option 1: disable RAID for ZFS ("IT-Mode" / "HBA-Mode")
Option 2: use ext4 on RAID10