I've finally discovered how to install qemu-agent on windows server core. Please see the method below:
Sourced from here: https://gist.github.com/goffinet/36e6581670cde2d016f620f6f490d281
Powershell in or to windows server core:
# display available drives
Get-PSDrive
# create local driver...