Hello!
I'm encountering an error with Proxmox API that does not allow me to upload files using API due to error thrown by PveProxy.
I did a fresh installation of Proxmox 7.2 using VM in Hyper-V with fixed disk size of 128gb and gen 2 VM. Proxmox is installed with LVM.
From my local syslog I can see this error:
Looking for any help I can get troubleshooting this strange error!!
I have plenty of space. The iso is only 600M.
Memory status:
Status of `local`-storage:
Client log for upload:
Server logs from pveproxy (debug does not output the error??!)
pveversion:
I'm encountering an error with Proxmox API that does not allow me to upload files using API due to error thrown by PveProxy.
I did a fresh installation of Proxmox 7.2 using VM in Hyper-V with fixed disk size of 128gb and gen 2 VM. Proxmox is installed with LVM.
From my local syslog I can see this error:
Aug 10 05:46:52 pvelab pveproxy[8637]: problem with client ::ffff:192.168.10.112; No space left on device
Looking for any help I can get troubleshooting this strange error!!
I have plenty of space. The iso is only 600M.
Code:
root@pvelab:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 3.9G 0 3.9G 0% /dev
tmpfs 795M 648K 795M 1% /run
/dev/mapper/pve-root 31G 4.3G 26G 15% /
tmpfs 3.9G 34M 3.9G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
/dev/sda2 511M 328K 511M 1% /boot/efi
/dev/fuse 128M 16K 128M 1% /etc/pve
tmpfs 795M 0 795M 0% /run/user/0
Memory status:
Code:
free -h
total used free shared buff/cache available
Mem: 7.8Gi 831Mi 6.5Gi 34Mi 418Mi 6.7Gi
Swap: 4.0Gi 0B 4.0Gi
root@pvelab:~#
Status of `local`-storage:
Code:
root@pvelab:~# pvesh get /storage/local/ --output-format=json
{"content":"snippets,iso,vztmpl,backup,rootdir","digest":"5820b6fbff46e80cc2d46da13d7c9354673bed22","path":"/var/lib/vz","shared":0,"storage":"local","type":"dir"}
root@pvelab:~# df -h /var/lib/vz
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/pve-root 31G 4.3G 26G 15% /
Client log for upload:
Code:
curl -k --verbose --cookie "$(<cookie)" --upload-file ./jammy-server-cloudimg-amd64.img https://192.168.10.113:8006/api2/json/nodes/pve/storage/local/upload
* Trying 192.168.10.113:8006...
* Connected to 192.168.10.113 (192.168.10.113) port 8006 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* TLSv1.0 (OUT), TLS header, Certificate Status (22):
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.2 (IN), TLS header, Certificate Status (22):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS header, Finished (20):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, CERT verify (15):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Finished (20):
* TLSv1.2 (OUT), TLS header, Finished (20):
* TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.3 (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
* ALPN, server did not agree to a protocol
* Server certificate:
* subject: OU=PVE Cluster Node; O=Proxmox Virtual Environment; CN=pvelab
* start date: Aug 8 14:55:38 2022 GMT
* expire date: Aug 7 14:55:38 2024 GMT
* issuer: CN=Proxmox Virtual Environment; OU=43f3a941-0e87-44c1-8d0e-2febbe8b46ca; O=PVE Cluster Manager CA
* SSL certificate verify result: unable to get local issuer certificate (20), continuing anyway.
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
> PUT /api2/json/nodes/pve/storage/local/upload HTTP/1.1
> Host: 192.168.10.113:8006
> User-Agent: curl/7.81.0
> Accept: */*
> Cookie: PVEAuthCookie=PVE:root@pam:62F326A5::0ZtYc7iOnjWJEuAaTiVdUFnRPxcd4Bp15W5AqEtD3NDcyeqlncsXfAJYjaJuxJ9H8eX2+TQZvYzkwbzRieEmGJ9AKf+yH4YiUC8wYyoC7wRN/Lti1j4DL2+dCnnjCThw1jsg7zZD6EAssjSDOdT8EZLxShV3IH0wPSCxxLtdSKn+3ug2WkbXxfRZ9XC9LelyFEoKIvlrlt1sZdok2rtj2cc0xMHoR/MfYxQfjOZbt2krivPdKEM/2Bb7rG4VzCKgg7ikY0stOXBYNfb0sZ70+2K8vnD7Y89HMZvcB5f2OFczKNNo8xF9T7wbNG7Fg/JbU34IR0IKDBPlITHuLevM6A==
> Content-Length: 630063104
> Expect: 100-continue
>
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.2 (IN), TLS header, Supplemental data (23):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* old SSL session ID is stale, removing
* Done waiting for 100-continue
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.2 (OUT), TLS header, Supplemental data (23):
* TLSv1.3 (OUT), TLS alert, decode error (562):
* OpenSSL SSL_read: error:0A000126:SSL routines::unexpected eof while reading, errno 0
* Closing connection 0
curl: (56) OpenSSL SSL_read: error:0A000126:SSL routines::unexpected eof while reading, errno 0
Server logs from pveproxy (debug does not output the error??!)
Code:
pveproxy start --debug 1
worker[8637]: PVE::APIServer::AnyEvent +1731: (eval): ACCEPT FH10 CONN1
Use of uninitialized value $token in pattern match (m//) at /usr/share/perl5/PVE/AccessControl.pm line 336.
Use of uninitialized value $token in pattern match (m//) at /usr/share/perl5/PVE/Ticket.pm line 32.
worker[8637]: PVE::APIServer::AnyEvent +1781: client_do_disconnect: close connection AnyEvent::Handle=HASH(0x5589b5fce8c8)
worker[8637]: PVE::APIServer::AnyEvent +1781: client_do_disconnect: CLOSE FH10 CONN0
pveversion:
Code:
pveversion -v
proxmox-ve: 7.2-1 (running kernel: 5.15.39-3-pve)
pve-manager: 7.2-7 (running version: 7.2-7/d0dd0e85)
pve-kernel-5.15: 7.2-8
pve-kernel-helper: 7.2-8
pve-kernel-5.15.39-3-pve: 5.15.39-3
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph-fuse: 15.2.16-pve1
corosync: 3.1.5-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve1
libproxmox-acme-perl: 1.4.2
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.2-4
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.2-2
libpve-guest-common-perl: 4.1-2
libpve-http-server-perl: 4.1-3
libpve-storage-perl: 7.2-7
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.2.5-1
proxmox-backup-file-restore: 2.2.5-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.5.1
pve-cluster: 7.2-2
pve-container: 4.2-2
pve-docs: 7.2-2
pve-edk2-firmware: 3.20210831-2
pve-firewall: 4.2-5
pve-firmware: 3.5-1
pve-ha-manager: 3.4.0
pve-i18n: 2.7-2
pve-qemu-kvm: 6.2.0-11
pve-xtermjs: 4.16.0-1
qemu-server: 7.2-3
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.7.1~bpo11+1
vncterm: 1.7-1
zfsutils-linux: 2.1.5-pve1
Last edited: