watchdog

  1. Watchdog for standalone proxmox node

    I have a single node "storage server" that has started randomly crashing. While I dont have the time (and its not a business critical node) to replace it, I would like the watchdog to trap and reboot- but here I run into a dilemma. I cant install the debian watchdog package because it conflicts...
  2. [TUTORIAL] Hardware watchdog at a per-VM level

    From my testing of Proxmox, one frustration I had was that unlike my previous Xen environment, Proxmox does not detect if a VM has panicked/crashed/frozen and as such won't reboot the VM, potentially ending up in hours of downtime until the issue is realised and resolved. After a bit of digging...
  3. Proxmox watchdog - how to increase countdown time

    Hello I have problem with watchdog coundown time resseting. I have enabled watchdog by using: https://pve.proxmox.com/wiki/High_Availability_Cluster_4.x#Dell_IDrac_.28module_.22ipmi_watchdog.22.29 I got: WATCHDOG_MODULE=ipmi_watchdog The defaults settings are: Watchdog Timer Use...
  4. Expected behavior from watchdog-mux with a networking outage? (HA, Corosync, and Softdog fencing)

    What’s the expected behavior here? I have a 3-node cluster with dedicated physical corosync network, and a 2nd faster network for storage and networking. The corosync network is configured to failover to the fast network if interrupted. High availability is configured on guests with shared...
  5. Python watchdog and proxmox gui

    Hey all, i am trying to create a watchdog that will listen to proxmox firewall files and will alert me when a fw rule was modified. I am using python watchdog package. when I modify the file (directly from shell) my watchdog is notice that and alert me. When editing the same firewall file...
  6. [SOLVED] Watchdog rebooted server at random moment - how to debug?

    I use Supermicro server with PVE 6.2. I did the watchdog setup this way: /etc/default/pve-ha-manager: WATCHDOG_MODULE=ipmi_watchdog /etc/modprobe.d/ipmi_watchdog.conf: options ipmi_watchdog action=power_cycle panic_wdt_timeout=10 /etc/default/grub GRUB_CMDLINE_LINUX_DEFAULT="quiet...
  7. erroneous VM setting caused a system fail

    Describing here a problem encountered. noteworthy is previously there were hugepages configured with the VM running and these were subsequently removed. Proxmox did not catch this imho. Booting a VM where the CPU configuration had pdpe1gb flag enabled this appeared to have resulted in initially...
  8. [SOLVED] Dedicated ceph storage nodes with HA stack disabled

    Hi all, I'm testing new setup where I have 3x storage boxes(with multiples drives) and 6x compute boxes (with two drives + more RAM) all are part of same cluster. I installed ceph on 3x storage nodes and added all the free drives from it as OSDs. ceph is up and running and I can use mounted...
  9. all nodes got rebooted and there is no log - Cluster disaster

    Hi folks I have added a new node to my cluster today, then I realized the new node's network configuration might have an issue that it cannot communicate with the CEPH IP ranges, I have restarted the network service using "systemctl restart networking" after this, the disaster happened and I...
  10. [SOLVED] Howto setup watchdog?

    Hi, I'm running PVE cluster on 6 nodes. In total 2 different server models are used, but all are from Lenovo. In the server configuration I can define 3 types of server timeouts: OS Watchdog Loader Watchdog Enable Power Off Delay I read here that by default all hardware watchdog modules are...
  11. Proxmox Host and Clients Randomly Freeze. Have to restart the system

    Hello all, I'm having some issues with my Proxmox host. Sometimes it will randomly lockup and freeze everything. The consol will still apear but won't accept any entered keys, SSH and the GUI also don't work. I am passing through a Nivdia GT710 to a Windows 10 Client. I thought this was the...
  12. i6300esb watchdog in Windows (help needed)

    I'm trying to force a windows guest reset on BSOD using the qemu watchdog functionality. After adding a virtual watchdog device /etc/pve/local/qemu-server/101.conf watchdog: model=i6300esb,action=reset to Windows VM it appears in the device manager as Intel(R) 6300ESB Watchdog timer - 25A...
  13. Hardware watchdog (ipmi_watchdog) on Proxmox 5

    Dear colleagues, I moved to Proxmox 5 in a dev environment and was wondering how to setup the hardware watchdog. On the same hardware running Proxmox 4, a kernel module ipmi_watchdog has been loaded. Now I can only find the following modules. lsmod |grep ipmi ipmi_ssif 24576 0...
  14. Upgraded to 5.0 headaches

    So I just upgraded to 5.0-23 tonight. When I try to boot the system, I now receive this error: [28.072000] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [swapper/0:1] The machine will keep spitting out variations of that error (only thing that changes is the timing. Instead of 23s it...
  15. [SOLVED] Watchdog fence for physical nodes

    In Proxmox 3.x I setup fencing using apc pdus. I did not have any HA VMs setup but if one of the Proxmox nodes locked up or crashed the node would fenced. Is it possible to replicate this behavior In 4.x and 5.x? I'm fine with the watchdog as the method of fencing just don't see a way to make...
  16. Watchdog raises iDRAC alert

    Hi. I have Proxmox 4.4 installed in a new Dell R630 with watchdog configured as explained in the Proxmox wiki which is just as the 6th comment in this other thread suggests: https://forum.proxmox.com/threads/configure-hardware-watchdog-ipmi-fencing.32989/ At the end of that comment it says: "at...
  17. grin

    dist-upgrade / reboot / watchdog

    As we have already talked about reboots, here's one fresh. From 4.4-5 to 4.4-13. Reboot is at the end. Apr 12 14:55:47 srv-01-szd systemd[1]: Stopped Corosync Cluster Engine. Apr 12 14:55:47 srv-01-szd systemd[1]: Starting Corosync Cluster Engine... Apr 12 14:55:47 srv-01-szd corosync[26358]...
  18. Software watchdog configuration

    We have a tree node cluster and our datacenter is having little networking issues those days. It means that part of the traffic is lost (resulting pings loss) and the watchdog on each node, which is the default software softdog, sees that the machine cannot contact the others and shutdown the...
  19. VM migration when server fail.

    Hello everybody! There is a cluster of two nodes (Proxmox 4.3, HP DL380 G9 Servers), HP MSA 2040 SAN connected via FC 8Gb. LVM shared for both nodes. Online and offline migration goes perfectly. The problem is when we are testing HA and restart to the one node or make disconnection to the...
  20. Win7 64bit guest, works with kvm64 cpu mode, crashes physical host with "host" cpu mode

    Hello, We created a VM for Windows 7 64bit. We didn't notice that we had the VM in kvm64 default mode until everything was fully installed and running. (We usually use "host" mode, because 3 of our nodes have the same specifications.) Now, if I shut down the Windows 7 guest, and configure it to...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!