Mikael,
In 2.6.27 the --swappages option was added, so 2.6.32 should have this option too. It fakes the idea of having real swap to the container - thus it's supposed to eliminate Java taking too much memory.
From what I've read in the wiki, the Proxmox VE GUI when it asks for Memory and Swap...