Hello:
I add a new node (pve4 - 192.168.0.54) with an old dell inspiron 560 motherboard but with HDD to create shared storage, and i'm unable to upload any iso file on it, or create a functionnal ZFS pool over iscsi.
At first it was pve2 with ip 192.168.0.52 but with some test, i nuke it. I removed properly the node with the pvecm command and remove any mention of this node in config file. I re add the node in cluster with new fresh install, new name new ip.
The node was able to create zfspool, and the cluster can see the zfs pool over an iscsi target using web gui but migrate any vm on it was a no go. I lookup over wiki, forum and all documentations possible on ZFS and iscsi with proxmox and my config was "fine" but can't migrate vm in web or command.
After a week, i nuke the zfspool and decide to create a openmediavault vm with a nfs or zfs/iscsi but with nicer gui but i was surprised that also ISO uplaod seems impossible.
The node can't take any iso file on his local LVM volume with error message in journalctl that it timed out and detect vanish client. (192.168.0.31 -> my local pc)
Other node work normally (proxmox - 192.168.0.51 and pve3 192.168.0.53). And migrate a vm on local lvm-thin on bug node local work (???)
I also lookup over a driver bug (Realtek RTL8168 but with R8169 driver) but it seems it's for older linux kernel than mine and normal internet connection work on pve4 node
journalctl -xe
Code:
Nov 04 19:39:20 proxmox pveproxy[542745]: multipart upload complete (size: 171583488B time: 9.989s rate: 16.38MiB/s filename: WinPE_x64.iso)
Nov 04 19:39:25 proxmox pveproxy[542745]: problem with client ::ffff:192.168.0.31; Connection timed out
Nov 04 19:39:28 proxmox pvedaemon[511530]: <root@pam> starting task UPID:proxmox:000C4257:0136649B:672914E0:imgcopy::root@pam:
Nov 04 19:39:28 proxmox pveproxy[542745]: proxy detected vanished client connection
Nov 04 19:39:35 proxmox pvedaemon[803415]: import failed: /usr/bin/scp: stat local "/var/tmp/pveupload-76de8609d69201f4c83e011f8dafad73": No such file or directory
Nov 04 19:39:35 proxmox pvedaemon[511530]: <root@pam> end task UPID:proxmox:000C4257:0136649B:672914E0:imgcopy::root@pam: import failed: /usr/bin/scp: stat local "/var/tm>
Nov 04 19:39:36 proxmox pveproxy[541800]: multipart upload complete (size: 171583488B time: 11.321s rate: 14.45MiB/s filename: WinPE_x64.iso)
Nov 04 19:39:44 proxmox pvedaemon[511529]: <root@pam> starting task UPID:proxmox:000C4285:01366B00:672914F0:imgcopy::root@pam:
Nov 04 19:39:44 proxmox pveproxy[541800]: proxy detected vanished client connection
Nov 04 19:39:50 proxmox pvedaemon[803461]: import failed: /usr/bin/scp: stat local "/var/tmp/pveupload-3370d8e16e0d2dd6f6edc9d829d1fd2d": No such file or directory
Nov 04 19:39:50 proxmox pvedaemon[511529]: <root@pam> end task UPID:proxmox:000C4285:01366B00:672914F0:imgcopy::root@pam: import failed: /usr/bin/scp: stat local "/var/tm>
Nov 04 19:42:10 proxmox pvedaemon[511530]: <root@pam> successful auth for user 'root@pam'I add a new node (pve4 - 192.168.0.54) with an old dell inspiron 560 motherboard but with HDD to create shared storage, and i'm unable to upload any iso file on it, or create a functionnal ZFS pool over iscsi.
At first it was pve2 with ip 192.168.0.52 but with some test, i nuke it. I removed properly the node with the pvecm command and remove any mention of this node in config file. I re add the node in cluster with new fresh install, new name new ip.
The node was able to create zfspool, and the cluster can see the zfs pool over an iscsi target using web gui but migrate any vm on it was a no go. I lookup over wiki, forum and all documentations possible on ZFS and iscsi with proxmox and my config was "fine" but can't migrate vm in web or command.
After a week, i nuke the zfspool and decide to create a openmediavault vm with a nfs or zfs/iscsi but with nicer gui but i was surprised that also ISO uplaod seems impossible.
The node can't take any iso file on his local LVM volume with error message in journalctl that it timed out and detect vanish client. (192.168.0.31 -> my local pc)
Other node work normally (proxmox - 192.168.0.51 and pve3 192.168.0.53). And migrate a vm on local lvm-thin on bug node local work (???)
I also lookup over a driver bug (Realtek RTL8168 but with R8169 driver) but it seems it's for older linux kernel than mine and normal internet connection work on pve4 node
pvecm status
Code:
Cluster information
-------------------
Name: sihome
Config Version: 5
Transport: knet
Secure auth: on
Quorum information
------------------
Date: Mon Nov 4 20:06:15 2024
Quorum provider: corosync_votequorum
Nodes: 3
Node ID: 0x00000001
Ring ID: 1.12b
Quorate: Yes
Votequorum information
----------------------
Expected votes: 3
Highest expected: 3
Total votes: 3
Quorum: 2
Flags: Quorate
Membership information
----------------------
Nodeid Votes Name
0x00000001 1 192.168.0.51 (local)
0x00000002 1 192.168.0.54
0x00000003 1 192.168.0.53
Code:
root@pve4:~# pveversion -v
proxmox-ve: 8.2.0 (running kernel: 6.8.12-2-pve)
pve-manager: 8.2.7 (running version: 8.2.7/3e0176e6bb2ade3b)
proxmox-kernel-helper: 8.1.0
proxmox-kernel-6.8: 6.8.12-3
proxmox-kernel-6.8.12-3-pve-signed: 6.8.12-3
proxmox-kernel-6.8.12-2-pve-signed: 6.8.12-2
proxmox-kernel-6.8.4-2-pve-signed: 6.8.4-2
ceph-fuse: 18.2.4-pve3
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx9
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.1
libproxmox-backup-qemu0: 1.4.1
libproxmox-rs-perl: 0.3.4
libpve-access-control: 8.1.4
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.8
libpve-cluster-perl: 8.0.8
libpve-common-perl: 8.2.5
libpve-guest-common-perl: 5.1.4
libpve-http-server-perl: 5.1.2
libpve-network-perl: 0.9.8
libpve-rs-perl: 0.8.10
libpve-storage-perl: 8.2.5
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.4.0-4
proxmox-backup-client: 3.2.7-1
proxmox-backup-file-restore: 3.2.7-1
proxmox-firewall: 0.5.0
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.2.3
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.2.4
pve-cluster: 8.0.8
pve-container: 5.2.0
pve-docs: 8.2.3
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.0.7
pve-firmware: 3.14-1
pve-ha-manager: 4.0.5
pve-i18n: 3.2.4
pve-qemu-kvm: 9.0.2-3
pve-xtermjs: 5.3.0-3
qemu-server: 8.2.4
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.6-pve1