The guest-agent FreeBSD port is not complete, it does not support fsfreeze/thaw (for consistent backups), so this, the most important feature is missing.
The only advantage you will get, is have the network/ip data shown in PVE - VM summary, if this is worth to compile and run an unstable piece...