Yes, absolutely!
If this is a single host you just create an "empty" bridge (e.g. "vmbr1") without a physical NIC. Give both VMs a NIC connected to this bridge, assign manually (there is no DHCP available on an isolated network!) an IP address and you are good to go
For the IP address range choose a free and unused and conflict-free network. See RFC1918
https://en.wikipedia.org/wiki/Private_network. Avoid to set a gateway - as there is none.
Good luck... and have fun!