It seems that /etc/lxc/default.conf doesn't have much bearing. /usr/share/lxc/config/common.conf seems to be a better fit except that you can't control it per container, it will be applied system wide to all containers.
Would be nice if it could be controlled per container.