interfaces = your.ipv4.network.address
bind interfaces only = Yes
But if you insist in disabling IPv6 at SO level
I think you could edit /etc/sysctl.conf (not tried yet)
Bash:
$ sudo nano /etc/sysctl.conf
# add these lines at bottom
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1
Save and close, reboot.
A possible caveat is that if you plan to use X Forwarding through ssh, disabling IPv6 can break it.
Also if you're using postfix, also will fail.
You'll have to point to your IPv4 loopback