[SOLVED] VM FreeNAS random shutdown

[lyubomyr83]

Hello. I have a big problem with my FreeNas virtual mashine. This mashine working several years without any problems till now. I upgrade my proxmox with last update and add ssd disk samsung 860 QVO 1 TB as extended disk to FreeNas pool. And it was done in the same time. After that when i read or write to FreeNas pool any information, my mashine is in random time switched off. Inside pool i have also two 1TB HDD. And before i haven't any problems. And now i don't know what is problem, ssd disk or last proxmox update. I am confused! Who can help me? With other two mashines - PfSense and Win 10 i haven't any problems, they still working when FreeNas go to withed off state.

pveversion -v:

proxmox-ve: 6.2-1 (running kernel: 5.4.34-1-pve)
pve-manager: 6.2-4 (running version: 6.2-4/9824574a)
pve-kernel-5.4: 6.2-1
pve-kernel-helper: 6.2-1
pve-kernel-5.3: 6.1-6
pve-kernel-5.0: 6.0-11
pve-kernel-5.4.34-1-pve: 5.4.34-2
pve-kernel-4.15: 5.4-17
pve-kernel-5.3.18-3-pve: 5.3.18-3
pve-kernel-5.0.21-5-pve: 5.0.21-10
pve-kernel-4.15.18-28-pve: 4.15.18-56
pve-kernel-4.15.18-12-pve: 4.15.18-36
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.0.3-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.15-pve1
libproxmox-acme-perl: 1.0.3
libpve-access-control: 6.1-1
libpve-apiclient-perl: 3.0-3
libpve-common-perl: 6.1-2
libpve-guest-common-perl: 3.0-10
libpve-http-server-perl: 3.0-5
libpve-storage-perl: 6.1-7
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.2-1
lxcfs: 4.0.3-pve2
novnc-pve: 1.1.0-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.2-1
pve-cluster: 6.1-8
pve-container: 3.1-5
pve-docs: 6.2-4
pve-edk2-firmware: 2.20200229-1
pve-firewall: 4.1-2
pve-firmware: 3.1-1
pve-ha-manager: 3.0-9
pve-i18n: 2.1-2
pve-qemu-kvm: 5.0.0-2
pve-xtermjs: 4.3.0-1
qemu-server: 6.2-2
smartmontools: 7.1-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
zfsutils-linux: 0.8.3-pve1

qm config 101:

balloon: 4096
bootdisk: ide0
cores: 4
cpu: qemu64
description: ide1%3A pmx-lvm%3Avm-101-disk-1,backup=0,size=900G%0Aide2%3A pmx-lvm2%3Avm-101-disk-1,backup=0,size=930G
ide0: local-lvm:vm-101-disk-0,size=8G
ide1: pmx-lvm:vm-101-disk-0,backup=0,size=900G
ide2: pmx-lvm2:vm-101-disk-0,backup=0,size=930G
ide3: pmx-lvm3:vm-101-disk-0,backup=0,size=930G,ssd=1
memory: 6144
name: FNS-465
net0: e1000=CA:82:FE:54:C9:11,bridge=vmbr0
numa: 0
onboot: 1
ostype: other
smbios1: uuid=33fd63bf-eb05-40d7-96c9-6c96168dd82d
sockets: 1
startup: order=2

 

[oguz]

hi,

did you reboot your node after the upgrades were complete? if not please try that first

if that doesn't work:

my mashine is in random time switched off

please post some logs for this, so we can figure out what the problem is. /var/log/syslog and journalctl output can be useful.

also if there are any errors on the PVE task log on the GUI, please post that as well

 

[lyubomyr83]

Yes host with proxmox with crontab i switch off at noon and switch on at 6:00 am every day.
I attach syslog here.

 

[lyubomyr83]

i catch this in journalctl:
when i copy files from FreeNas CMB to Proxmox attached usb disk storage

 

[lyubomyr83]

You can see, when copy process go, FreeNas randomly go offline

 

[lyubomyr83]

You can see also in log - storage NFS FreeNAS is not online. But nothing more!

 

[lyubomyr83]

Maybe it's FreeNAS problem....

 

[oguz]

You can see also in log - storage NFS FreeNAS is not online. But nothing more!

well that's already a good starting point..

probably there's some problem connecting to your storage. check if your nfs storage is mounted on your PVE host. maybe there's a network issue.

 

[Lyubomyr]

well that's already a good starting point..

probably there's some problem connecting to your storage. check if your nfs storage is mounted on your PVE host. maybe there's a network issue.

NFS storage mounted to proxmox host share from my FreeNAS VM which is down, so it can't be reached becase source in face VM is switched off. Why she is switched of randomly, i'll to know.

 

[Lyubomyr]

hi,

did you reboot your node after the upgrades were complete? if not please try that first

if that doesn't work:


please post some logs for this, so we can figure out what the problem is. /var/log/syslog and journalctl output can be useful.

also if there are any errors on the PVE task log on the GUI, please post that as well
And no answers... My problem not fixed yet. I think, its ssd problem. But why? SSS is new bought 2 weeks ago. Dear admins, can you advise me something?

And no answers... My problem not fixed yet. I think, its ssd problem. But why? SSS is new bought 2 weeks ago. Dear admins, can you advise me something?

 

[oguz]

to check for SSD problems, use smartctl -a DEVICE for example smartctl -a /dev/sda (find the device name in lsblk). in the output you will see any issues..

 

[Lyubomyr]

The output:

 

[Lyubomyr]

to check for SSD problems, use smartctl -a DEVICE for example smartctl -a /dev/sda (find the device name in lsblk). in the output you will see any issues..

Nothing. No errors. I think disk is good. Why i receive problems with ssd. I have 2 hdd and i haven't problems before. I try change sata ports for this ssd, but it not help.

 

[oguz]

the disk you're using should have smartctl capabilities... but it says it doesn't, and also the serial number looks really funny. where did you buy this disk?

here is a regular output from the same disk:

# smartctl --all /dev/sda
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.41-1-pve] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION === 
Device Model:     Samsung SSD 860 QVO 1TB 
Serial Number:    [REDACTED SERIAL NUM]
LU WWN Device Id: 5 002538 e701bae35
Firmware Version: RVQ01B6Q
User Capacity:    1,000,204,886,016 bytes [1.00 TB] 
Sector Size:      512 bytes logical/physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
Device is:        Not in smartctl database [for details use: -P showall]
ATA Version is:   ACS-4 T13/BSR INCITS 529 revision 5
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue May 26 11:41:43 2020 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

 

[lyubomyr83]

Ok, I try to reinstall my FreeNAS VM without any extended disks, only with host disk (I add 2 partitions 32gb for system and 40gb for pool). And when I try use transmission plugin for download or try put some data to pool disk, I receive randomly switching off this VM. Another two machines feel good in the same time. And I think, it’s happening when try put something to disk. So, it’s problem FreeNAS system or proxmox? Can anybody answer?

 

[lyubomyr83]

I try to ask in iXsystems forum and receive answer:

 

[lyubomyr83]

Changing network driver (VMWare vmxnet3) for adapter solve the problem.