Hello,
how do you want to connect to your VMs? Via RDP, or SSH?
Ports are not just 'subgroups of IP addresses', they work on a different network layer.
So if you think that instead of 'aaa.bbb.ccc.ddd' you can input 'aaa.bbb.ccc.ddd:9001' in all your favourite programs then that won't in general.
Kind regards,
Benedikt