Somehow since PVE 7.3 this doesn't seem to work anymore.
When logging in via SSH, I am still getting this output:
root@carrier-2:~# pveversion
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LC_CTYPE...