[SOLVED] New to v8 - uploading ISO failing

[slothy2406]

HI all,

I am returning to Proxmox for a homelab and thought I would give the latest version a spin. I have installed it to a little HP Elitedesk 705 G3, with a single SSD (Sata) 1TB drive in it (for now).

All loaded using default settings (bar location) and host is all running as it should be.

My problem is the uploading of ISOs through the GUI, unless the iso is really small is always seems to fail. Now searching around its seems that the /var/tmp directory is too small to handle larger iso. I know that I can upload through FTP and SCP, but surely the GUI should work, as most OS isos are 2+ Gb these days.

Is there something I had missed in the setup, say the HD partitioning, was there an option to set the size of the tmp folder??
Is using a single disk not a suggested build requirement, there seems to be plenty of space on the local drive

Filesystem            Size  Used Avail Use% Mounted on
udev                  7.5G     0  7.5G   0% /dev
tmpfs                 1.6G 1012K  1.6G   1% /run
/dev/mapper/pve-root   94G  3.0G   87G   4% /
tmpfs                 7.6G   34M  7.5G   1% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
efivarfs              122K   53K   65K  45% /sys/firmware/efi/efivars
/dev/sda2            1022M   12M 1011M   2% /boot/efi
/dev/fuse             128M   16K  128M   1% /etc/pve
tmpfs                 1.6G     0  1.6G   0% /run/user/0

I saw there was a bug tracker for this issue (Bug 4935), but it seems that this is still on going and hasn't been looked at since March this year.

Have I done something wrong or is the FTP/SCP workaround the only option?

Thanks

Andy

 

[LnxBil]

You can upload the iso via the API, as layed out in this post. Or you can ssh into your pve and download the iso from there. This is the easiest method I know. Why download the iso to your machine and then upload again ...

 

[slothy2406]

is the API method the same as the Download from URL - the problem is that the iso location stores the files as bz files rather than ISOs. It just seems odd that the "normal" method of uploading doesn't work....

A bit of an update, I have installed a secondary drive for the OS, reinstalled on to the new disk and now uploading from the GUI works. So I dont know if the issue was with the fact that it was a single drive install?

Another update...
So the tmp folder seems to have grown a bit with a new drive used, but its still not enough for the gui uploads and once again crashes the system. I will go off and start SCP isos.

 

[slothy2406]

Current df -h and findmnt commands

root@pve:~# df -h
Filesystem            Size  Used Avail Use% Mounted on
udev                  7.5G     0  7.5G   0% /dev
tmpfs                 1.6G  1.5M  1.6G   1% /run
/dev/mapper/pve-root  220G  4.0G  207G   2% /
tmpfs                 7.6G   34M  7.5G   1% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
efivarfs              122K   58K   60K  50% /sys/firmware/efi/efivars
/dev/sda1             916G  1.5G  868G   1% /mnt/pve/pve-data
/dev/sdb2            1022M   12M 1011M   2% /boot/efi
/dev/fuse             128M   16K  128M   1% /etc/pve
tmpfs                 1.6G     0  1.6G   0% /run/user/0


root@pve:~# findmnt -lo source,target,fstype,used,avail
SOURCE               TARGET                                              FSTYPE       USED   AVAIL
sysfs                /sys                                                sysfs           0       0
proc                 /proc                                               proc            0       0
udev                 /dev                                                devtmpfs        0    7.5G
devpts               /dev/pts                                            devpts          0       0
tmpfs                /run                                                tmpfs        1.4M    1.5G
/dev/mapper/pve-root /                                                   ext4           4G  206.2G
securityfs           /sys/kernel/security                                securityfs      0       0
tmpfs                /dev/shm                                            tmpfs       33.5M    7.5G
tmpfs                /run/lock                                           tmpfs           0      5M
cgroup2              /sys/fs/cgroup                                      cgroup2         0       0
pstore               /sys/fs/pstore                                      pstore          0       0
efivarfs             /sys/firmware/efi/efivars                           efivarfs    57.8K   59.1K
bpf                  /sys/fs/bpf                                         bpf             0       0
systemd-1            /proc/sys/fs/binfmt_misc                            autofs          0       0
mqueue               /dev/mqueue                                         mqueue          0       0
hugetlbfs            /dev/hugepages                                      hugetlbfs       0       0
debugfs              /sys/kernel/debug                                   debugfs         0       0
tracefs              /sys/kernel/tracing                                 tracefs         0       0
fusectl              /sys/fs/fuse/connections                            fusectl         0       0
configfs             /sys/kernel/config                                  configfs        0       0
ramfs                /run/credentials/systemd-sysusers.service           ramfs           0       0
ramfs                /run/credentials/systemd-tmpfiles-setup-dev.service ramfs           0       0
/dev/sda1            /mnt/pve/pve-data                                   ext4         1.5G  867.8G
/dev/sdb2            /boot/efi                                           vfat        11.7M 1010.3M
ramfs                /run/credentials/systemd-sysctl.service             ramfs           0       0
ramfs                /run/credentials/systemd-tmpfiles-setup.service     ramfs           0       0
binfmt_misc          /proc/sys/fs/binfmt_misc                            binfmt_misc     0       0
sunrpc               /run/rpc_pipefs                                     rpc_pipefs      0       0
lxcfs                /var/lib/lxcfs                                      fuse.lxcfs      0       0
/dev/fuse            /etc/pve                                            fuse          16K    128M
tmpfs                /run/user/0                                         tmpfs           0    1.5G

 

[slothy2406]

I have just managed to use a personal web server (Rebux Tiny webserver) and I still get the issue downloading to either of the disks (both now set to ISO storage) but it fails on both scp and url download to both disks. These are both fairly new disks (one M.2 SSD and the other is a SATA SSD).

 

[slothy2406]

My latest work around seems to work - initiating a wget from the proxmox server getting the data from a local webserver!! Worked straight away and it copied 2.032G in 26s

 

[slothy2406]

Nope, another failure, but wait, what happens if I use a different NIC, I plug in a old USB3 NIC (based on Realtek 8152) and rebooted.

Wow, what a difference, I was able to upload iso from the GUI with no issues, tried with Ubuntu server (2.2Gb), OPNsense (2.1Gb), Kali net installer (500Mb). All completed within a minute, no errors, no website unavailable, system still pingable. So it wasn't a space issue it was a NIC adapter issue!

So a quick google-fu and it does seem there is issues with the onboard NIC in a HP elitedesk 705 G3, and it seems to only affect onboard NICs, adpater cards based on the same chipset seem to work fine (from what I have read). I now need to work out if I can update the firmware on the NIC or whether I just go with USB NICs for the moment.

What is it with Broadcom messing with the virtualisation world, first it was VMware and the debacle that was the migration of VMware support to its own systems, and now they are messing with Proxmox and their dodgy firmware!!