Depends on your network layout, but normally, one pfSense VM cannot filter everything. The firewall in PVE is at multiple levels: Datacenter, Node and VM. To get the same potential security, you would need to have a pfSense in front of every VM of have #VMs network interfaces, each connected to a VM.
The number of default entries is very small, so the impact on performance is negligible.