On a 32 GB server, I give 3 gb for each machine of 6. So 6*3 = 18 GB but total ram usage is around 26 GB
What is the point here? (Not using ballooning.)
Buffers
ZFS ARC cache
Other system processes
and so on...
If you use ZFS, check with arc_summary how much RAM is being used by ZFS ARC cache, if you want you can limit it in /etc/modprobe.d/zfs.conf with options zfs zfs_arc_max= <MAX RAM IN BYTES>