Debian RAM hot-unplug error: Parameter verification failed. (400)memory: hotplug problem - 400 Parameter verificati

nsky.link

New Member
Feb 3, 2022
12
0
1
24
Hello!
I'm facing hot-unplug issue in Debian VM
Code:
Operating System: Debian GNU/Linux 10 (buster)
Kernel: Linux 4.19.0-25-cloud-amd64

Which is on Proxmox
Code:
proxmox-ve: 7.3-1 (running kernel: 5.15.107-2-pve)
pve-manager: 7.4-17 (running version: 7.4-17/513c62be)

In the "Options" of the VM in Proxmox, "Disk, Network, USB, Memory" are indicated
NUMA - also has the “true” state
"memhp_default_state=online" was added to the grub and the "update-grub" was made. VM was shutdown and started.

VM has:
Code:
CPU(s): 8
 Memory: 32G

I can't use hot-unplug in Proxmox and reduce the memory to 16,384 MB. Because I get an error in the proxmox web interface after a timeout of about 10 seconds.

Code:
Parameter verification failed. (400)

memory: hotplug problem - 400 Parameter verification failed. dimm46: error unplug memory module

And I get error msg in dmesg

Code:
[ 7267.305701] memory memory276: Offline failed.
[ 7267.323125] Offlined Pages 32768
[ 7267.325257] Offlined Pages 32768
[ 7267.327526] Offlined Pages 32768
[ 7267.329599] Offlined Pages 32768
[ 7267.331664] memory memory276: Offline failed.
[ 7267.348972] Offlined Pages 32768
[ 7267.351225] Offlined Pages 32768
[ 7267.353343] Offlined Pages 32768
[ 7267.355505] Offlined Pages 32768
[ 7267.357488] memory memory276: Offline failed.

But I can successfully add 1024 or remove 1024 MB. Before I launch Percona XtraDB Cluster.

After launching Percona, I have the opportunity to add more memory, and if I try to reduce it, I get the error described above.

Please help me understand why I am getting this error.

I also noticed that when hot-unplug is enabled, Percona XtraDB Cluster does not work correctly and produces errors in the logs
Code:
[ERROR] Error log throttle: 884 'Can't create thread to handle new connection' error(s) suppressed
[ERROR] Can't create thread to handle new connection(errno= 11)
[ERROR] Error log throttle: 895 'Can't create thread to handle new connection' error(s) suppressed
[ERROR] Can't create thread to handle new connection(errno= 11)
[ERROR] Error log throttle: 904 'Can't create thread to handle new connection' error(s) suppressed

After disabling hot-unplug for the VM, Percona began to work stably and without errors.
 
Last edited:
Hi,
Hello!
I'm facing hot-unplug issue in Debian VM
Code:
Operating System: Debian GNU/Linux 10 (buster)
Kernel: Linux 4.19.0-25-cloud-amd64
that kernel is rather old and there might have been some fixes related to memory hotplug since then.

Code:
Parameter verification failed. (400)

memory: hotplug problem - 400 Parameter verification failed. dimm46: error unplug memory module
The module couldn't be unplugged, most likely because the guest kernel was unable to relocate memory from there to another module.

I also noticed that when hot-unplug is enabled, Percona XtraDB Cluster does not work correctly and produces errors in the logs
Code:
[ERROR] Error log throttle: 884 'Can't create thread to handle new connection' error(s) suppressed
[ERROR] Can't create thread to handle new connection(errno= 11)
[ERROR] Error log throttle: 895 'Can't create thread to handle new connection' error(s) suppressed
[ERROR] Can't create thread to handle new connection(errno= 11)
[ERROR] Error log throttle: 904 'Can't create thread to handle new connection' error(s) suppressed

After disabling hot-unplug for the VM, Percona began to work stably and without errors.
Just when it's enabled or after you (try to) hotplug/unplug memory?
 
The module couldn't be unplugged, most likely because the guest kernel was unable to relocate memory from there to another module.
Yes, I thought about the same thing, but how can I overcome this?
Just when it's enabled or after you (try to) hotplug/unplug memory?
Just when it's enabled. As soon as I disable the hotplug ops, percona works without errors
 
Yes, I thought about the same thing, but how can I overcome this?
If it's a limitation of the guest kernel (it's clear, but looks like it could be), there's nothing you can do.
Just when it's enabled. As soon as I disable the hotplug ops, percona works without errors
Could also be related to the guest kernel, but sounds rather strange. You'd need to debug the issue further to see what exactly happens (as for the error in the logs, errno 11 is EAGAIN 11 Resource temporarily unavailable).
 
If it's a limitation of the guest kernel (it's clear, but looks like it could be), there's nothing you can do.

Could also be related to the guest kernel, but sounds rather strange. You'd need to debug the issue further to see what exactly happens (as for the error in the logs, errno 11 is EAGAIN 11 Resource temporarily unavailable).
Could this be related?
On this VM lsmem gives me this list:
Code:
# lsmem
RANGE                                  SIZE  STATE REMOVABLE   BLOCK
0x0000000000000000-0x0000000007ffffff  128M online        no       0
0x0000000008000000-0x000000000fffffff  128M online       yes       1
0x0000000010000000-0x0000000017ffffff  128M online        no       2
0x0000000018000000-0x0000000037ffffff  512M online       yes     3-6
0x0000000038000000-0x000000003fffffff  128M online        no       7
0x0000000100000000-0x0000000107ffffff  128M online        no      32
0x0000000108000000-0x0000000117ffffff  256M online       yes   33-34
0x0000000118000000-0x000000011fffffff  128M online        no      35
0x0000000120000000-0x0000000137ffffff  384M online       yes   36-38
0x0000000138000000-0x000000013fffffff  128M online        no      39
0x0000000140000000-0x0000000157ffffff  384M online       yes   40-42
0x0000000158000000-0x000000015fffffff  128M online        no      43
0x0000000160000000-0x0000000177ffffff  384M online       yes   44-46
0x0000000178000000-0x000000017fffffff  128M online        no      47
0x0000000180000000-0x0000000197ffffff  384M online       yes   48-50
0x0000000198000000-0x000000019fffffff  128M online        no      51
0x00000001a0000000-0x00000001b7ffffff  384M online       yes   52-54
0x00000001b8000000-0x00000001bfffffff  128M online        no      55
0x00000001c0000000-0x00000001d7ffffff  384M online       yes   56-58
0x00000001d8000000-0x00000001dfffffff  128M online        no      59
0x00000001e0000000-0x00000001f7ffffff  384M online       yes   60-62
0x00000001f8000000-0x00000001ffffffff  128M online        no      63
0x0000000200000000-0x0000000217ffffff  384M online       yes   64-66
0x0000000218000000-0x000000021fffffff  128M online        no      67
0x0000000220000000-0x0000000237ffffff  384M online       yes   68-70
0x0000000238000000-0x000000023fffffff  128M online        no      71
0x0000000240000000-0x0000000257ffffff  384M online       yes   72-74
0x0000000258000000-0x000000025fffffff  128M online        no      75
0x0000000260000000-0x0000000277ffffff  384M online       yes   76-78
0x0000000278000000-0x000000027fffffff  128M online        no      79
0x0000000280000000-0x0000000297ffffff  384M online       yes   80-82
0x0000000298000000-0x000000029fffffff  128M online        no      83
0x00000002a0000000-0x00000002b7ffffff  384M online       yes   84-86
0x00000002b8000000-0x00000002bfffffff  128M online        no      87
0x00000002c0000000-0x00000002d7ffffff  384M online       yes   88-90
0x00000002d8000000-0x00000002dfffffff  128M online        no      91
0x00000002e0000000-0x00000002f7ffffff  384M online       yes   92-94
0x00000002f8000000-0x00000002ffffffff  128M online        no      95
0x0000000300000000-0x0000000317ffffff  384M online       yes   96-98
0x0000000318000000-0x000000031fffffff  128M online        no      99
0x0000000320000000-0x0000000337ffffff  384M online       yes 100-102
0x0000000338000000-0x000000033fffffff  128M online        no     103
0x0000000340000000-0x0000000357ffffff  384M online       yes 104-106
0x0000000358000000-0x000000035fffffff  128M online        no     107
0x0000000360000000-0x0000000377ffffff  384M online       yes 108-110
0x0000000378000000-0x000000037fffffff  128M online        no     111
0x0000000380000000-0x0000000397ffffff  384M online       yes 112-114
0x0000000398000000-0x000000039fffffff  128M online        no     115
0x00000003a0000000-0x00000003b7ffffff  384M online       yes 116-118
0x00000003b8000000-0x00000003bfffffff  128M online        no     119
0x00000003c0000000-0x00000003d7ffffff  384M online       yes 120-122
0x00000003d8000000-0x00000003dfffffff  128M online        no     123
0x00000003e0000000-0x00000003f7ffffff  384M online       yes 124-126
0x00000003f8000000-0x00000003ffffffff  128M online        no     127
0x0000000400000000-0x0000000417ffffff  384M online       yes 128-130
0x0000000418000000-0x000000041fffffff  128M online        no     131
0x0000000420000000-0x0000000437ffffff  384M online       yes 132-134
0x0000000438000000-0x000000043fffffff  128M online        no     135
0x0000000440000000-0x0000000457ffffff  384M online       yes 136-138
0x0000000458000000-0x000000045fffffff  128M online        no     139
0x0000000460000000-0x0000000477ffffff  384M online       yes 140-142
0x0000000478000000-0x000000047fffffff  128M online        no     143
0x0000000480000000-0x0000000487ffffff  128M online       yes     144
0x0000000488000000-0x000000048fffffff  128M online        no     145
0x0000000490000000-0x0000000497ffffff  128M online       yes     146
0x0000000498000000-0x000000049fffffff  128M online        no     147
0x00000004a0000000-0x00000004b7ffffff  384M online       yes 148-150
0x00000004b8000000-0x00000004bfffffff  128M online        no     151
0x00000004c0000000-0x00000004d7ffffff  384M online       yes 152-154
0x00000004d8000000-0x00000004dfffffff  128M online        no     155
0x00000004e0000000-0x00000004f7ffffff  384M online       yes 156-158
0x00000004f8000000-0x00000004ffffffff  128M online        no     159
0x0000000500000000-0x0000000507ffffff  128M online       yes     160
0x0000000508000000-0x0000000517ffffff  256M online        no 161-162
0x0000000518000000-0x0000000537ffffff  512M online       yes 163-166
0x0000000538000000-0x0000000547ffffff  256M online        no 167-168
0x0000000548000000-0x0000000577ffffff  768M online       yes 169-174
0x0000000578000000-0x000000057fffffff  128M online        no     175
0x0000000580000000-0x00000005b7ffffff  896M online       yes 176-182
0x00000005b8000000-0x00000005bfffffff  128M online        no     183
0x00000005c0000000-0x00000005f7ffffff  896M online       yes 184-190
0x00000005f8000000-0x00000005ffffffff  128M online        no     191
0x0000000600000000-0x0000000637ffffff  896M online       yes 192-198
0x0000000638000000-0x000000063fffffff  128M online        no     199
0x0000000640000000-0x0000000677ffffff  896M online       yes 200-206
0x0000000678000000-0x000000067fffffff  128M online        no     207
0x0000000680000000-0x00000006b7ffffff  896M online       yes 208-214
0x00000006b8000000-0x00000006bfffffff  128M online        no     215
0x00000006c0000000-0x00000006f7ffffff  896M online       yes 216-222
0x00000006f8000000-0x00000006ffffffff  128M online        no     223
0x0000000700000000-0x0000000737ffffff  896M online       yes 224-230
0x0000000738000000-0x000000073fffffff  128M online        no     231
0x0000000740000000-0x0000000777ffffff  896M online       yes 232-238
0x0000000778000000-0x000000077fffffff  128M online        no     239
0x0000000780000000-0x00000007b7ffffff  896M online       yes 240-246
0x00000007b8000000-0x00000007bfffffff  128M online        no     247
0x00000007c0000000-0x00000007f7ffffff  896M online       yes 248-254
0x00000007f8000000-0x00000007ffffffff  128M online        no     255
0x0000000800000000-0x0000000837ffffff  896M online       yes 256-262
0x0000000838000000-0x000000083fffffff  128M online        no     263
0x0000000840000000-0x0000000877ffffff  896M online       yes 264-270
0x0000000878000000-0x00000008bfffffff  1.1G online        no 271-279

Memory block size:       128M
Total online memory:      32G
Total offline memory:      0B

And another VM on Linux kernel 5.10.0-26-cloud-amd64 on another proxmox cluster:
Code:
# lsmem
RANGE                                 SIZE  STATE REMOVABLE     BLOCK
0x0000000000000000-0x000000003fffffff   1G online       yes       0-7
0x0000010000000000-0x00000103bfffffff  15G online       yes 8192-8311

Memory block size:       128M
Total online memory:      16G
Total offline memory:      0B
 
if linux kernel have set some memory pages as unmovable, it's impossible to unplug the dimm.

(In the future, with coming virtio-mem feature, it should be easier to unplug memory)
You can see an example lsmem above. Is this what you are talking about?
 
Could also be related to the guest kernel, but sounds rather strange. You'd need to debug the issue further to see what exactly happens (as for the error in the logs, errno 11 is EAGAIN 11 Resource temporarily unavailable).
The issue is that I cannot reproduce the problem on a similar VM in a test environment. The error occurred on those production cluster VMs on which the hotplug was enabled. But it is not reproduced on a single VM in a test environment with the hotplug enabled and in another production cluster VMs without hotplug ops.
 
(In the future, with coming virtio-mem feature, it should be easier to unplug memory)
For that feature, users will also need newer guest kernels though ;) (at the very least 5.10)

Could this be related?
On this VM lsmem gives me this list:
Code:
# lsmem
RANGE                                  SIZE  STATE REMOVABLE   BLOCK
0x0000000000000000-0x0000000007ffffff  128M online        no       0
0x0000000008000000-0x000000000fffffff  128M online       yes       1
0x0000000010000000-0x0000000017ffffff  128M online        no       2
0x0000000018000000-0x0000000037ffffff  512M online       yes     3-6
0x0000000038000000-0x000000003fffffff  128M online        no       7
0x0000000100000000-0x0000000107ffffff  128M online        no      32
0x0000000108000000-0x0000000117ffffff  256M online       yes   33-34
0x0000000118000000-0x000000011fffffff  128M online        no      35
0x0000000120000000-0x0000000137ffffff  384M online       yes   36-38
0x0000000138000000-0x000000013fffffff  128M online        no      39
0x0000000140000000-0x0000000157ffffff  384M online       yes   40-42
0x0000000158000000-0x000000015fffffff  128M online        no      43
0x0000000160000000-0x0000000177ffffff  384M online       yes   44-46
0x0000000178000000-0x000000017fffffff  128M online        no      47
0x0000000180000000-0x0000000197ffffff  384M online       yes   48-50
0x0000000198000000-0x000000019fffffff  128M online        no      51
0x00000001a0000000-0x00000001b7ffffff  384M online       yes   52-54
0x00000001b8000000-0x00000001bfffffff  128M online        no      55
0x00000001c0000000-0x00000001d7ffffff  384M online       yes   56-58
0x00000001d8000000-0x00000001dfffffff  128M online        no      59
0x00000001e0000000-0x00000001f7ffffff  384M online       yes   60-62
0x00000001f8000000-0x00000001ffffffff  128M online        no      63
0x0000000200000000-0x0000000217ffffff  384M online       yes   64-66
0x0000000218000000-0x000000021fffffff  128M online        no      67
0x0000000220000000-0x0000000237ffffff  384M online       yes   68-70
0x0000000238000000-0x000000023fffffff  128M online        no      71
0x0000000240000000-0x0000000257ffffff  384M online       yes   72-74
0x0000000258000000-0x000000025fffffff  128M online        no      75
0x0000000260000000-0x0000000277ffffff  384M online       yes   76-78
0x0000000278000000-0x000000027fffffff  128M online        no      79
0x0000000280000000-0x0000000297ffffff  384M online       yes   80-82
0x0000000298000000-0x000000029fffffff  128M online        no      83
0x00000002a0000000-0x00000002b7ffffff  384M online       yes   84-86
0x00000002b8000000-0x00000002bfffffff  128M online        no      87
0x00000002c0000000-0x00000002d7ffffff  384M online       yes   88-90
0x00000002d8000000-0x00000002dfffffff  128M online        no      91
0x00000002e0000000-0x00000002f7ffffff  384M online       yes   92-94
0x00000002f8000000-0x00000002ffffffff  128M online        no      95
0x0000000300000000-0x0000000317ffffff  384M online       yes   96-98
0x0000000318000000-0x000000031fffffff  128M online        no      99
0x0000000320000000-0x0000000337ffffff  384M online       yes 100-102
0x0000000338000000-0x000000033fffffff  128M online        no     103
0x0000000340000000-0x0000000357ffffff  384M online       yes 104-106
0x0000000358000000-0x000000035fffffff  128M online        no     107
0x0000000360000000-0x0000000377ffffff  384M online       yes 108-110
0x0000000378000000-0x000000037fffffff  128M online        no     111
0x0000000380000000-0x0000000397ffffff  384M online       yes 112-114
0x0000000398000000-0x000000039fffffff  128M online        no     115
0x00000003a0000000-0x00000003b7ffffff  384M online       yes 116-118
0x00000003b8000000-0x00000003bfffffff  128M online        no     119
0x00000003c0000000-0x00000003d7ffffff  384M online       yes 120-122
0x00000003d8000000-0x00000003dfffffff  128M online        no     123
0x00000003e0000000-0x00000003f7ffffff  384M online       yes 124-126
0x00000003f8000000-0x00000003ffffffff  128M online        no     127
0x0000000400000000-0x0000000417ffffff  384M online       yes 128-130
0x0000000418000000-0x000000041fffffff  128M online        no     131
0x0000000420000000-0x0000000437ffffff  384M online       yes 132-134
0x0000000438000000-0x000000043fffffff  128M online        no     135
0x0000000440000000-0x0000000457ffffff  384M online       yes 136-138
0x0000000458000000-0x000000045fffffff  128M online        no     139
0x0000000460000000-0x0000000477ffffff  384M online       yes 140-142
0x0000000478000000-0x000000047fffffff  128M online        no     143
0x0000000480000000-0x0000000487ffffff  128M online       yes     144
0x0000000488000000-0x000000048fffffff  128M online        no     145
0x0000000490000000-0x0000000497ffffff  128M online       yes     146
0x0000000498000000-0x000000049fffffff  128M online        no     147
0x00000004a0000000-0x00000004b7ffffff  384M online       yes 148-150
0x00000004b8000000-0x00000004bfffffff  128M online        no     151
0x00000004c0000000-0x00000004d7ffffff  384M online       yes 152-154
0x00000004d8000000-0x00000004dfffffff  128M online        no     155
0x00000004e0000000-0x00000004f7ffffff  384M online       yes 156-158
0x00000004f8000000-0x00000004ffffffff  128M online        no     159
0x0000000500000000-0x0000000507ffffff  128M online       yes     160
0x0000000508000000-0x0000000517ffffff  256M online        no 161-162
0x0000000518000000-0x0000000537ffffff  512M online       yes 163-166
0x0000000538000000-0x0000000547ffffff  256M online        no 167-168
0x0000000548000000-0x0000000577ffffff  768M online       yes 169-174
0x0000000578000000-0x000000057fffffff  128M online        no     175
0x0000000580000000-0x00000005b7ffffff  896M online       yes 176-182
0x00000005b8000000-0x00000005bfffffff  128M online        no     183
0x00000005c0000000-0x00000005f7ffffff  896M online       yes 184-190
0x00000005f8000000-0x00000005ffffffff  128M online        no     191
0x0000000600000000-0x0000000637ffffff  896M online       yes 192-198
0x0000000638000000-0x000000063fffffff  128M online        no     199
0x0000000640000000-0x0000000677ffffff  896M online       yes 200-206
0x0000000678000000-0x000000067fffffff  128M online        no     207
0x0000000680000000-0x00000006b7ffffff  896M online       yes 208-214
0x00000006b8000000-0x00000006bfffffff  128M online        no     215
0x00000006c0000000-0x00000006f7ffffff  896M online       yes 216-222
0x00000006f8000000-0x00000006ffffffff  128M online        no     223
0x0000000700000000-0x0000000737ffffff  896M online       yes 224-230
0x0000000738000000-0x000000073fffffff  128M online        no     231
0x0000000740000000-0x0000000777ffffff  896M online       yes 232-238
0x0000000778000000-0x000000077fffffff  128M online        no     239
0x0000000780000000-0x00000007b7ffffff  896M online       yes 240-246
0x00000007b8000000-0x00000007bfffffff  128M online        no     247
0x00000007c0000000-0x00000007f7ffffff  896M online       yes 248-254
0x00000007f8000000-0x00000007ffffffff  128M online        no     255
0x0000000800000000-0x0000000837ffffff  896M online       yes 256-262
0x0000000838000000-0x000000083fffffff  128M online        no     263
0x0000000840000000-0x0000000877ffffff  896M online       yes 264-270
0x0000000878000000-0x00000008bfffffff  1.1G online        no 271-279

Memory block size:       128M
Total online memory:      32G
Total offline memory:      0B
Yes, there's a whole lot of unremovable small blocks. Can you share the VM configuration? Anything different to the other one you compared it with? Any special boot options you are using in the VM?
 
Yes, there's a whole lot of unremovable small blocks. Can you share the VM configuration? Anything different to the other one you compared it with? Any special boot options you are using in the VM?
Let me show you the differences. For example, a VM with the Percona will be VM “P”, and a VM without the Percona will be VM “W”

Code:
P:
CPU - 8
RAM - 32
SCSI Controller - VirtIO SCSI
HARD DISK(virtio0) - vmdata:vm-101....
HARD DISK(virtio1) - vmdata:vm-101....
HARD DISK(virtio2) - vmdata:vm-101....

W:
CPU - 16
RAM - 16
SCSI Controller - VirtIO SCSI single
HARD DISK(scsi0) - rpool:vm-121....

It's all a configuration difference. If you meant something different, please let me know.
 
While testing, I came across a situation - I can’t add more memory to VM “P” than 47 GB.
I add 65536, but it cuts to 47 GB and gives an error:
Code:
Parameter verification failed. (400)

memory: hotplug problem - VM 127 qmp command 'device_add' failed - a used vhost backend has no free memory slots left

At the same time, in lsmem I see new lines:

Code:
----------previous values--------------------------------------------
0x00000008c0000000-0x00000008f7ffffff  896M online       yes 280-286
0x00000008f8000000-0x00000008ffffffff  128M online        no     287
0x0000000900000000-0x0000000937ffffff  896M online       yes 288-294
0x0000000938000000-0x000000093fffffff  128M online        no     295
0x0000000940000000-0x0000000977ffffff  896M online       yes 296-302
0x0000000978000000-0x000000097fffffff  128M online        no     303
0x0000000980000000-0x00000009b7ffffff  896M online       yes 304-310
0x00000009b8000000-0x00000009bfffffff  128M online        no     311
0x00000009c0000000-0x00000009f7ffffff  896M online       yes 312-318
0x00000009f8000000-0x00000009ffffffff  128M online        no     319
0x0000000a00000000-0x0000000a37ffffff  896M online       yes 320-326
0x0000000a38000000-0x0000000a3fffffff  128M online        no     327
0x0000000a40000000-0x0000000a77ffffff  896M online       yes 328-334
0x0000000a78000000-0x0000000a7fffffff  128M online        no     335
0x0000000a80000000-0x0000000ab7ffffff  896M online       yes 336-342
0x0000000ab8000000-0x0000000abfffffff  128M online        no     343
0x0000000ac0000000-0x0000000af7ffffff  896M online       yes 344-350
0x0000000af8000000-0x0000000affffffff  128M online        no     351
0x0000000b00000000-0x0000000b37ffffff  896M online       yes 352-358
0x0000000b38000000-0x0000000b3fffffff  128M online        no     359
0x0000000b40000000-0x0000000b77ffffff  896M online       yes 360-366
0x0000000b78000000-0x0000000b7fffffff  128M online        no     367
0x0000000b80000000-0x0000000bb7ffffff  896M online       yes 368-374
0x0000000bb8000000-0x0000000bbfffffff  128M online        no     375
0x0000000bc0000000-0x0000000bf7ffffff  896M online       yes 376-382
0x0000000bf8000000-0x0000000bffffffff  128M online        no     383
0x0000000c00000000-0x0000000c37ffffff  896M online       yes 384-390
0x0000000c38000000-0x0000000c3fffffff  128M online        no     391
0x0000000c40000000-0x0000000c7fffffff    1G online       yes 392-399

Memory block size:       128M
Total online memory:      47G
Total offline memory:      0B
 
For that feature, users will also need newer guest kernels though ;) (at the very least 5.10)


Yes, there's a whole lot of unremovable small blocks. Can you share the VM configuration? Anything different to the other one you compared it with? Any special boot options you are using in the VM?
Do you have any ideas about a whole lot of unremovable small blocks ?
 
Do you have any ideas about a whole lot of unremovable small blocks ?
Unfortunately not. But if the only significant difference between the VMs is whether there is Percona or not, it might be related to that.
 
Unfortunately not. But if the only significant difference between the VMs is whether there is Percona or not, it might be related to that.
Do you think that due to the presence of Percona on the VM - a sign of a large number of unremovable small memory blocks ?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!