porxmox 3.4 kernel: waiting module removal not supported: please upgrade

[biolkell]

hellow
I watch syslog and kern.log after reboot machine and see:

pr 30 16:50:01 test pve-firewall[2395]: clear firewall rules
    Apr 30 16:50:01 test spiceproxy[2462]: received signal TERM
    Apr 30 16:50:01 test spiceproxy[2462]: server closing
    Apr 30 16:50:01 test spiceproxy[2463]: worker exit
    Apr 30 16:50:01 test pve-firewall[2395]: server stopped
    Apr 30 16:50:01 test spiceproxy[2462]: worker 2463 finished
    Apr 30 16:50:01 test spiceproxy[2462]: server stopped
    Apr 30 16:50:01 test pvesh: <root@pam> starting task     UPID:test:0000209A:0002AA7F:55424119:stopall::root@pam:
    Apr 30 16:50:01 test pvesh: <root@pam> end task     UPID:test:0000209A:0002AA7F:55424119:stopall::root@pam: OK
    [B]Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:01 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade[/B]
    Apr 30 16:50:02 test kernel: FS-Cache: Netfs 'nfs' unregistered from     caching
    Apr 30 16:50:02 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 16:50:02 test kernel: Slow work thread pool: Shutting down
    Apr 30 16:50:02 test kernel: Slow work thread pool: Shut down     complete
    Apr 30 16:50:02 test kernel: FS-Cache: Unloaded
    Apr 30 16:50:02 test pvepw-logger[2268]: received terminate request     (signal)
    Apr 30 16:50:02 test pvepw-logger[2268]: stopping pvefw logger
    Apr 30 16:50:02 test pvestatd[2435]: received signal TERM
    Apr 30 16:50:02 test pvestatd[2435]: server closing
    Apr 30 16:50:02 test pvestatd[2435]: server stopped

Apr 30 12:22:33 test pmxcfs[2262]: [status] notice: RRDC update     error /var/lib/rrdcached/db/pve2-node/test: -3
    Apr 30 12:22:33 test pvesh: <root@pam> end task     UPID:test:0005C9A2:00EE3760:55420263:stopall::root@pam: OK
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test pvestatd[2547]: received signal TERM
    Apr 30 12:22:33 test pvestatd[2547]: server closing
    Apr 30 12:22:33 test pvestatd[2547]: server stopped
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: FS-Cache: Netfs 'nfs' unregistered from     caching
    Apr 30 12:22:33 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 12:22:33 test kernel: Slow work thread pool: Shutting down
    Apr 30 12:22:33 test kernel: Slow work thread pool: Shut down     complete
    Apr 30 12:22:33 test kernel: FS-Cache: Unloaded

test kernel: waiting module removal not supported: please upgrade i see i two machinedell poweregel r520 and computer type PC.
Message was exist on host where proxmox is installer.


i testing which module stoping worng i find this:

root@test:~# modprobe -r nfs
    FATAL: Module nfs is in use.
    root@test:~# date >> /var/log/syslog
    root@test:~# modprobe -r vzcpt >> /var/log/syslog
    FATAL: Module vzcpt is in use.
    root@test:~# modprobe -r vzrst
    [B]root@test:~# modprobe -r vzcpt[/B]
    root@test:~# modprobe -r pio_nfs

vzcpt generation message kernel: waiting module removal not supported: please upgrade

Thu Apr 30 17:16:46 CEST 2015
    Apr 30 17:17:01 test /USR/SBIN/CRON[6672]: (root) CMD (   cd /     && run-parts --report /etc/cron.hourly)
    Apr 30 17:17:23 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:23 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:23 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:23 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:23 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:23 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:34 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:34 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:34 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:34 test kernel: FS-Cache: Netfs 'nfs' unregistered from     caching
    Apr 30 17:17:34 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:17:34 test kernel: Slow work thread pool: Shutting down
    Apr 30 17:17:34 test kernel: Slow work thread pool: Shut down     complete
    Apr 30 17:17:34 test kernel: FS-Cache: Unloaded
    Apr 30 17:18:14 test pveproxy[6088]: worker exit
    Apr 30 17:18:14 test pveproxy[2454]: worker 6088 finished
    Apr 30 17:18:14 test pveproxy[2454]: starting 1 worker(s)
    Apr 30 17:18:14 test pveproxy[2454]: worker 6785 started
    date

but i testing more i see this message when i disable this modoule - something else fataled stop

Apr 30 17:30:19 test ntpd[2103]: peers refreshed
    Apr 30 17:30:20 test pveproxy[3488]: worker exit
    Apr 30 17:30:20 test pveproxy[3487]: worker exit
    Apr 30 17:30:20 test pveproxy[3489]: worker exit
    Apr 30 17:30:20 test pvedaemon[2422]: received signal TERM
    Apr 30 17:30:20 test pvedaemon[2422]: server closing
    Apr 30 17:30:20 test pvedaemon[2424]: worker exit
    Apr 30 17:30:20 test pvedaemon[2423]: worker exit
    Apr 30 17:30:20 test pvedaemon[2425]: worker exit
    Apr 30 17:30:21 test pvedaemon[2422]: worker 2423 finished
    Apr 30 17:30:21 test pvedaemon[2422]: worker 2424 finished
    Apr 30 17:30:21 test pvedaemon[2422]: worker 2425 finished
    Apr 30 17:30:21 test pvedaemon[2422]: server stopped
    Apr 30 17:30:22 test pmxcfs[2181]: [main] notice: teardown     filesystem
    Apr 30 17:30:22 test iscsid: iscsid shutting down.
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:22 test kernel: waiting module removal not supported:     please upgrade
    
    
    
    Apr 30 17:30:17 test spiceproxy[2471]: server stopped
    Apr 30 17:30:17 test pvesh: <root@pam> starting task     UPID:test:00000D3E:0000D298:55424A89:stopall::root@pam:
    Apr 30 17:30:17 test pvesh: <root@pam> end task     UPID:test:00000D3E:0000D298:55424A89:stopall::root@pam: OK
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test pmxcfs[2181]: [status] notice: RRDC update     error /var/lib/rrdcached/db/pve2-node/test: -3
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: FS-Cache: Netfs 'nfs' unregistered from     caching
    Apr 30 17:30:17 test kernel: waiting module removal not supported:     please upgrade
    Apr 30 17:30:17 test kernel: Slow work thread pool: Shutting down
    Apr 30 17:30:17 test kernel: Slow work thread pool: Shut down     complete

Maby someone see in log waiting module removal not supported: please upgrade or someone create solution .
this message is normal ?

 

[e100]

I have posted about this problem long ago and never found a solution.

Very annoying as it causes the reboot to take many minutes longer than necessary.

 

[apmuthu]

This bug was reported in Fedora 20 and since it was EOL and no test was reported thereafter, it was left in limbo.

The kernel module fix is available for those who want to compile it themselves:
https://lkml.org/lkml/2014/4/24/40
http://www.gossamer-threads.com/lists/linux/kernel/1909763
https://patchwork.ozlabs.org/patch/358162/

diff --git a/kernel/module.c b/kernel/module.c
index 11869408f79b..ae7821898bf2 100644
--- a/kernel/module.c
+++ b/kernel/module.c
@@ -815,9 +815,6 @@ SYSCALL_DEFINE2(delete_module, const char __user *, name_user,
return -EFAULT;
name[MODULE_NAME_LEN-1] = '\0';

- if (!(flags & O_NONBLOCK))
- pr_warn("waiting module removal not supported: please upgrade\n");
-
if (mutex_lock_interruptible(&module_mutex) != 0)
return -EINTR;