Why ram usage higher than allowed in vms?

Buffers
ZFS ARC cache
Other system processes
and so on...

If you use ZFS, check with arc_summary how much RAM is being used by ZFS ARC cache, if you want you can limit it in /etc/modprobe.d/zfs.conf with options zfs zfs_arc_max= <MAX RAM IN BYTES>