Some random hints, additional to
@Supaman 's advice:
- is the BIOS up to date? Verify that!
- you already had run memtest. How long? Let it run at least over night.
- how are the guests configured? Do you over-commit CPU cores, or worse: RAM?
- you mentioned TrueNAS. Anything "passed-through" involved?
Not crash-related but important for reliability without data loss:
- get some more storage devices to build mirrors and use ZFS

To find the reason for those crashes examine the journal. If you run the system
now and the
previous boot had crashed then look into
journalctl -b -1 -e
. "-b -1" lists entries of the first boot
before the current one. "-e" jumps to the end, to the latest entries. (See also
man journalctl
.) Search for error messages between the last line and (only) a few minutes before that one...
Thank you for reaching out!
I know BIOS is most likely not the latest.
Memtest was probably 3-5 hours in the first run (96GB)
Definitely far from over committing. I think I have a 6 cpu / 16GB RAM and a 2 cpu / 16 GB RAM
No pass through currently
I want some more storage, just wanted to get stability figured out lol.
Some of the journal output:
Mar 10 09:50:00 bcw-prox smartd[1877]: Device: /dev/sda [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 69 to 70
Mar 10 09:50:06 bcw-prox smartd[1877]: Device: /dev/sdd [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 71 to 72
Mar 10 09:50:06 bcw-prox smartd[1877]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 29 to 28
Mar 10 09:55:01 bcw-prox CRON[1240912]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 09:55:01 bcw-prox CRON[1240913]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 09:55:01 bcw-prox CRON[1240912]: pam_unix(cron:session): session closed for user root
Mar 10 09:55:27 bcw-prox postfix/qmgr[2217]: EED1E1B28Csize=1044, nrcpt=1 (queue active)
Mar 10 09:55:27 bcw-prox postfix/local[1241076]: error: open database /etc/aliases.db: No such file or directory
Mar 10 09:55:27 bcw-prox postfix/local[1241076]: warning: hash:/etc/aliases is unavailable. open database /etc/aliases.db: No such file or directory
Mar 10 09:55:27 bcw-prox postfix/local[1241076]: warning: hash:/etc/aliases: lookup of 'root' failed
Mar 10 09:55:27 bcw-prox postfix/local[1241076]: EED1E1B28C: to=, orig_to=<root>, relay=local, delay=63327, delays=63327/0.01/0/0.35, dsn=4.3.0, status=deferred (alias database unavailable)
Mar 10 09:58:41 bcw-prox pveproxy[1223543]: worker exit
Mar 10 09:58:41 bcw-prox pveproxy[2295]: worker 1223543 finished
Mar 10 09:58:41 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 09:58:41 bcw-prox pveproxy[2295]: worker 1242252 started
Mar 10 10:03:36 bcw-prox pvedaemon[1211731]: <root@pam> successful auth for user 'root@pam'
Mar 10 10:05:01 bcw-prox CRON[1244495]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:05:01 bcw-prox CRON[1244496]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 10:05:01 bcw-prox CRON[1244495]: pam_unix(cron:session): session closed for user root
Mar 10 10:05:09 bcw-prox pveproxy[1227727]: worker exit
Mar 10 10:05:09 bcw-prox pveproxy[2295]: worker 1227727 finished
Mar 10 10:05:09 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 10:05:09 bcw-prox pveproxy[2295]: worker 1244562 started
Mar 10 10:08:25 bcw-prox pvedaemon[1211731]: worker exit
Mar 10 10:08:25 bcw-prox pvedaemon[2288]: worker 1211731 finished
Mar 10 10:08:25 bcw-prox pvedaemon[2288]: starting 1 worker(s)
Mar 10 10:08:25 bcw-prox pvedaemon[2288]: worker 1245719 started
Mar 10 10:12:33 bcw-prox pvedaemon[1212862]: worker exit
Mar 10 10:12:33 bcw-prox pvedaemon[2288]: worker 1212862 finished
Mar 10 10:12:33 bcw-prox pvedaemon[2288]: starting 1 worker(s)
Mar 10 10:12:33 bcw-prox pvedaemon[2288]: worker 1247219 started
Mar 10 10:15:01 bcw-prox CRON[1248095]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:15:01 bcw-prox CRON[1248096]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 10:15:01 bcw-prox CRON[1248095]: pam_unix(cron:session): session closed for user root
Mar 10 10:17:01 bcw-prox CRON[1248805]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:17:01 bcw-prox CRON[1248806]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 10 10:17:01 bcw-prox CRON[1248805]: pam_unix(cron:session): session closed for user root
Mar 10 10:19:36 bcw-prox pvedaemon[1245719]: <root@pam> successful auth for user 'root@pam'
Mar 10 10:20:01 bcw-prox smartd[1877]: Device: /dev/sdc [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 69 to 70
Mar 10 10:20:01 bcw-prox smartd[1877]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 31 to 30
Mar 10 10:25:01 bcw-prox CRON[1251623]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:25:01 bcw-prox CRON[1251624]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 10:25:01 bcw-prox CRON[1251623]: pam_unix(cron:session): session closed for user root
Mar 10 10:34:36 bcw-prox pvedaemon[1231938]: <root@pam> successful auth for user 'root@pam'
Mar 10 10:35:01 bcw-prox CRON[1255165]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:35:01 bcw-prox CRON[1255166]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 10:35:01 bcw-prox CRON[1255165]: pam_unix(cron:session): session closed for user root
Mar 10 10:35:55 bcw-prox pveproxy[1237958]: worker exit
Mar 10 10:35:55 bcw-prox pveproxy[2295]: worker 1237958 finished
Mar 10 10:35:55 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 10:35:55 bcw-prox pveproxy[2295]: worker 1255470 started
Mar 10 10:45:01 bcw-prox CRON[1258727]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:45:01 bcw-prox CRON[1258728]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 10:45:01 bcw-prox CRON[1258727]: pam_unix(cron:session): session closed for user root
Mar 10 10:50:36 bcw-prox pvedaemon[1247219]: <root@pam> successful auth for user 'root@pam'
Mar 10 10:53:09 bcw-prox pveproxy[1242252]: worker exit
Mar 10 10:53:09 bcw-prox pveproxy[1244562]: worker exit
Mar 10 10:53:09 bcw-prox pveproxy[2295]: worker 1242252 finished
Mar 10 10:53:09 bcw-prox pveproxy[2295]: worker 1244562 finished
Mar 10 10:53:09 bcw-prox pveproxy[2295]: starting 2 worker(s)
Mar 10 10:53:09 bcw-prox pveproxy[2295]: worker 1261647 started
Mar 10 10:53:09 bcw-prox pveproxy[2295]: worker 1261648 started
Mar 10 10:55:01 bcw-prox CRON[1262264]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 10:55:01 bcw-prox CRON[1262265]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 10:55:01 bcw-prox CRON[1262264]: pam_unix(cron:session): session closed for user root
Mar 10 11:05:01 bcw-prox CRON[1265835]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:05:01 bcw-prox CRON[1265836]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 11:05:01 bcw-prox CRON[1265835]: pam_unix(cron:session): session closed for user root
Mar 10 11:05:27 bcw-prox postfix/qmgr[2217]: EED1E1B28C: from=size=1044, nrcpt=1 (queue active)
Mar 10 11:05:27 bcw-prox postfix/local[1265982]: error: open database /etc/aliases.db: No such file or directory
Mar 10 11:05:27 bcw-prox postfix/local[1265982]: warning: hash:/etc/aliases is unavailable. open database /etc/aliases.db: No such file or directory
Mar 10 11:05:27 bcw-prox postfix/local[1265982]: warning: hash:/etc/aliases: lookup of 'root' failed
Mar 10 11:05:27 bcw-prox postfix/local[1265982]: EED1E1B28C: to= orig_to=<root>, relay=local, delay=67526, delays=67526/0.01/0/0.01, dsn=4.3.0, status=deferred (alias database unavailable)
Mar 10 11:06:27 bcw-prox pvedaemon[1231938]: worker exit
Mar 10 11:06:27 bcw-prox pvedaemon[2288]: worker 1231938 finished
Mar 10 11:06:27 bcw-prox pvedaemon[2288]: starting 1 worker(s)
Mar 10 11:06:27 bcw-prox pvedaemon[2288]: worker 1266330 started
Mar 10 11:06:36 bcw-prox pvedaemon[1247219]: <root@pam> successful auth for user 'root@pam'
Mar 10 11:15:01 bcw-prox CRON[1269385]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:15:01 bcw-prox CRON[1269386]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 11:15:01 bcw-prox CRON[1269385]: pam_unix(cron:session): session closed for user root
Mar 10 11:17:01 bcw-prox CRON[1270134]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:17:01 bcw-prox CRON[1270135]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 10 11:17:01 bcw-prox CRON[1270134]: pam_unix(cron:session): session closed for user root
Mar 10 11:21:36 bcw-prox pvedaemon[1245719]: <root@pam> successful auth for user 'root@pam'
Mar 10 11:23:05 bcw-prox pveproxy[1255470]: worker exit
Mar 10 11:23:05 bcw-prox pveproxy[2295]: worker 1255470 finished
Mar 10 11:23:05 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 11:23:05 bcw-prox pveproxy[2295]: worker 1272251 started
Mar 10 11:25:01 bcw-prox CRON[1272925]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:25:01 bcw-prox CRON[1272926]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 11:25:01 bcw-prox CRON[1272925]: pam_unix(cron:session): session closed for user root
Mar 10 11:35:01 bcw-prox CRON[1276516]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:35:01 bcw-prox CRON[1276517]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 11:35:01 bcw-prox CRON[1276516]: pam_unix(cron:session): session closed for user root
Mar 10 11:37:36 bcw-prox pvedaemon[1245719]: <root@pam> successful auth for user 'root@pam'
Mar 10 11:43:17 bcw-prox pveproxy[1261647]: worker exit
Mar 10 11:43:17 bcw-prox pveproxy[2295]: worker 1261647 finished
Mar 10 11:43:17 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 11:43:17 bcw-prox pveproxy[2295]: worker 1279440 started
Mar 10 11:44:41 bcw-prox pveproxy[1261648]: worker exit
Mar 10 11:44:41 bcw-prox pveproxy[2295]: worker 1261648 finished
Mar 10 11:44:41 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 11:44:41 bcw-prox pveproxy[2295]: worker 1279937 started
Mar 10 11:45:01 bcw-prox CRON[1280055]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:45:01 bcw-prox CRON[1280056]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 11:45:01 bcw-prox CRON[1280055]: pam_unix(cron:session): session closed for user root
Mar 10 11:50:00 bcw-prox smartd[1877]: Device: /dev/sda [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 70 to 69
Mar 10 11:50:00 bcw-prox smartd[1877]: Device: /dev/sdb [SAT], SMART Usage Attribute: 2 Throughput_Performance changed from 128 to 129
Mar 10 11:50:01 bcw-prox smartd[1877]: Device: /dev/sdc [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 70 to 69
Mar 10 11:50:01 bcw-prox smartd[1877]: Device: /dev/sdc [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 30 to 31
Mar 10 11:52:36 bcw-prox pvedaemon[1245719]: <root@pam> successful auth for user 'root@pam'
Mar 10 11:53:07 bcw-prox pvedaemon[1247219]: worker exit
Mar 10 11:53:07 bcw-prox pvedaemon[2288]: worker 1247219 finished
Mar 10 11:53:07 bcw-prox pvedaemon[2288]: starting 1 worker(s)
Mar 10 11:53:07 bcw-prox pvedaemon[2288]: worker 1282922 started
Mar 10 11:55:01 bcw-prox CRON[1283640]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 11:55:01 bcw-prox CRON[1283641]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 11:55:01 bcw-prox CRON[1283640]: pam_unix(cron:session): session closed for user root
Mar 10 11:56:53 bcw-prox pvedaemon[1245719]: worker exit
Mar 10 11:56:53 bcw-prox pvedaemon[2288]: worker 1245719 finished
Mar 10 11:56:53 bcw-prox pvedaemon[2288]: starting 1 worker(s)
Mar 10 11:56:53 bcw-prox pvedaemon[2288]: worker 1284285 started
Mar 10 12:05:01 bcw-prox CRON[1287206]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 12:05:01 bcw-prox CRON[1287207]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 12:05:01 bcw-prox CRON[1287206]: pam_unix(cron:session): session closed for user root
Mar 10 12:06:24 bcw-prox systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
Mar 10 12:06:24 bcw-prox systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.
Mar 10 12:06:24 bcw-prox systemd[1]: Finished systemd-tmpfiles-clean.service - Cleanup of Temporary Directories.
Mar 10 12:06:24 bcw-prox systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dclean.service.mount: Deactivated successfully.
Mar 10 12:08:36 bcw-prox pvedaemon[1266330]: <root@pam> successful auth for user 'root@pam'
Mar 10 12:12:51 bcw-prox pveproxy[1272251]: worker exit
Mar 10 12:12:51 bcw-prox pveproxy[2295]: worker 1272251 finished
Mar 10 12:12:51 bcw-prox pveproxy[2295]: starting 1 worker(s)
Mar 10 12:12:51 bcw-prox pveproxy[2295]: worker 1290007 started
Mar 10 12:15:01 bcw-prox CRON[1290752]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 12:15:01 bcw-prox CRON[1290753]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 12:15:01 bcw-prox CRON[1290752]: pam_unix(cron:session): session closed for user root
Mar 10 12:15:28 bcw-prox postfix/qmgr[2217]: EED1E1B28C: from=, size=1044, nrcpt=1 (queue active)
Mar 10 12:15:28 bcw-prox postfix/local[1290890]: error: open database /etc/aliases.db: No such file or directory
Mar 10 12:15:28 bcw-prox postfix/local[1290890]: warning: hash:/etc/aliases is unavailable. open database /etc/aliases.db: No such file or directory
Mar 10 12:15:28 bcw-prox postfix/local[1290890]: warning: hash:/etc/aliases: lookup of 'root' failed
Mar 10 12:15:29 bcw-prox postfix/local[1290890]: EED1E1B2, orig_to=<root>, relay=local, delay=71729, delays=71727/0.01/0/1.3, dsn=4.3.0, status=deferred (alias database unavailable)
Mar 10 12:17:01 bcw-prox CRON[1291468]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 12:17:01 bcw-prox CRON[1291469]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Mar 10 12:17:01 bcw-prox CRON[1291468]: pam_unix(cron:session): session closed for user root
Mar 10 12:20:07 bcw-prox smartd[1877]: Device: /dev/sdd [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 72 to 71
Mar 10 12:20:07 bcw-prox smartd[1877]: Device: /dev/sdd [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 28 to 29
Mar 10 12:23:36 bcw-prox pvedaemon[1282922]: <root@pam> successful auth for user 'root@pam'
Mar 10 12:25:01 bcw-prox CRON[1294242]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Mar 10 12:25:01 bcw-prox CRON[1294243]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Mar 10 12:25:01 bcw-prox CRON[1294242]: pam_unix(cron:session): session closed for user root