Yes, it is not a good idea. Read more in the Proxmox wiki.
Right, I have done some tests before moving with ballooning to production and found that bad idea. No ballooning anymore ever :)
I suggest not migrating between DRBD hosts before changing cache mode and checking DRBD consistency...