Reducing the size of filesystems or block devices is always finicky. Basically you always want to shrink things from the inside out. So first you shrink the FS, then the partition, then the disk or volume.
The error says, in plain English: "You are allowing the VM to use 463.49GiB of a 320GiB...