Strange behavior on a single node - hanging on Proxmox Helper-Scripts execution

[rfox]

I have a small cluster of 5 mixed machines - one of which is running a virtual OPNSense as firewall. Everything is running fine, but recently I noticed a strange issue which I can't find what's causing it . . .

When running a script from Proxmox Helper Scripts (https://tteck.github.io/Proxmox/) in the console _Shell - it just seems to hang, nothing happens. I can Cntl-C back to the prompt, but the script doesn't execute. Same script works fine with the other 4 nodes

I tried various scripts with the same strange result - after pasting the command and itting enter - nothing happens.

Have since rebooted several times and problem still exists - yet system seems to be running just fine otherwise ?!?

HW is an R86s-G2 device running fine since the last 8 months - and the scripts previously works on this device

Not sure how to troubleshoot short of reinstalling Proxmox fresh on that device ?!?

 

[leesteken]

When running a script from Proxmox Helper Scripts (https://tteck.github.io/Proxmox/) in the console _Shell - it just seems to hang, nothing happens. I can Cntl-C back to the prompt, but the script doesn't execute. Same script works fine with the other 4 nodes

I see a lot of this "I run some script from tteck and something went wrong" here. Maybe ask tteck first?

EDIT: Proxmox works fine on 5 of your nodes, so I can't be Proxmox? I don't see your logic.

 

[rfox]

I see a lot of this "I run some script from tteck and something went wrong" here. Maybe ask tteck first?

Thanks for your prompt reply - The exact same command line works on 4 out of 5 Proxmox nodes - so it's not the scripts themselves, it's something with the bash execution on this particular machine ?!?

Take this one for example:
bash -c "$(wget -qLO - https://github.com/tteck/Proxmox/raw/main/misc/microcode.sh)"

For checking and updating the microcode - when executed on the other nodes, it works as expected - just on one particular node, when I hit enter to execute the script - nothing happens . . . I can only hit Ctrl-C and machine continues to run fine . . .

 

[Astraea]

I'm in the same camp as @leesteken would check with the writer of the script as they are essential unsupported modifications to the Proxmox VE environment. However have you looked at the scripts and tried running the commands manually on the node that is having the issue to see if you can get any more information? Is that note showing any other errors in any of the logs and or during regular updates using the Proxmox GUI.

I personally don't use almost any pre-written scripts from other people, though I will look at said scripts and make my own after understanding the commands it executes and testing in a development environment before moving to my production environment.

 

[rfox]

I'm in the same camp as @leesteken would check with the writer of the script as they are essential unsupported modifications to the Proxmox VE environment. However have you looked at the scripts and tried running the commands manually on the node that is having the issue to see if you can get any more information? Is that note showing any other errors in any of the logs and or during regular updates using the Proxmox GUI.

I personally don't use almost any pre-written scripts from other people, though I will look at said scripts and make my own after understanding the commands it executes and testing in a development environment before moving to my production environment.

OK - so it appears to be something with the wget command not being able to fetch the script ?!? Hangs during the connection - here's the output from both examples - the broken node (R86s) and a working one (awowfox)

So it would appear to be a networking issue of sorts . . . will investigate further - THX

root@R86s:~# wget https://github.com/tteck/Proxmox/raw/main/turnkey/turnkey.sh
--2024-04-20 12:48:54-- https://github.com/tteck/Proxmox/raw/main/turnkey/turnkey.sh
Resolving github.com (github.com)... 140.82.121.4
Connecting to github.com (github.com)|140.82.121.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://raw.githubusercontent.com/tteck/Proxmox/main/turnkey/turnkey.sh [following]
--2024-04-20 12:48:54-- https://raw.githubusercontent.com/tteck/Proxmox/main/turnkey/turnkey.sh
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 2606:50c0:8002::154, 2606:50c0:8003::154, 2606:50c0:8000::154, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|2606:50c0:8002::154|:443... ^C
root@R86s:~#

root@awowfox:~# wget https://github.com/tteck/Proxmox/raw/main/turnkey/turnkey.sh
--2024-04-20 12:50:17-- https://github.com/tteck/Proxmox/raw/main/turnkey/turnkey.sh
Resolving github.com (github.com)... 140.82.121.4
Connecting to github.com (github.com)|140.82.121.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://raw.githubusercontent.com/tteck/Proxmox/main/turnkey/turnkey.sh [following]
--2024-04-20 12:50:17-- https://raw.githubusercontent.com/tteck/Proxmox/main/turnkey/turnkey.sh
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 2606:50c0:8003::154, 2606:50c0:8000::154, 2606:50c0:8001::154, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|2606:50c0:8003::154|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 6970 (6.8K) [text/plain]
Saving to: ‘turnkey.sh’

turnkey.sh 100%[======================================================================================>] 6.81K --.-KB/s in 0s

2024-04-20 12:50:17 (46.1 MB/s) - ‘turnkey.sh’ saved [6970/6970]

 

[Astraea]

Are you able to ping say Google or another external destination on all your nodes? Have you reviewed your networking configuration on all nodes to confirm they are correct? Have you check your upstream switches and their setting if you are using any management features such as VLANs or LACP? Have you checked your firewall rules and logs to see if there is any information there as well?

 

[rfox]

Thx for the suggestions - here's what I checked:

Pinging with IPs and names works fine . . .
Networking config on all nodes appears to be correct . . .
Switches checked - all OK, and YES - using VLANs and LACP for quite some time without issue . . .
Firewall live view shows nothing strange when attempting the wget command from affected node . . .

Tried wget with verbose and debug on - nothing special, just stops at same point as above (before the Ctrl-C)

 

[rfox]

Funny enough - I have a PiHole running as a LXC container on said node and I can use the wget command just fine to fetch the script - just not from the node console ?!?

 

[rfox]

UPDATE - after more testing, I narrowed it down to wget defaulting and failing while using IPv6 - if I force IPv4 - it works !!!

Used this command:
wget --inet4-only https://github.com/tteck/Proxmox/raw/main/turnkey/turnkey.sh

so something strange about IPv6 from this particular node's console