Hey,
I'm having an issue regarding SWAP and RAM usage.
swappines is set to 1. My hosts are consuming alot of RAM, most is buffer/cache.
The Problem is the swap usage at 100%. This problem consists only on some hosts.
root@hp1s01:~# free -m
total used free shared buff/cache available
Mem: 386939 74277 3362 723 309298 309354
Swap: 1951 1951 0
If I clean the swap with
swapoff -a and swapon -a it looks OK for a while.
The the host starts again fillig up swap.
There is a call trace before the problem starts to come up.
[554545.805748] ksoftirqd/17: page allocation failure: order:2, mode:0x1084020(GFP_ATOMIC|__GFP_COMP), nodemask=(null)
[554545.805751] ksoftirqd/17 cpuset=/ mems_allowed=0-1
[554545.805757] CPU: 17 PID: 114 Comm: ksoftirqd/17 Not tainted 4.15.18-1-pve #1
[554545.805758] Hardware name: HP ProLiant BL460c Gen8, BIOS I31 05/21/2018
[554545.805759] Call Trace:
[554545.805770] dump_stack+0x63/0x8b
[554545.805773] warn_alloc+0xfc/0x190
[554545.805774] __alloc_pages_slowpath+0xefa/0xf10
[554545.805778] ? br_handle_frame_finish+0x2c3/0x450
[554545.805780] __alloc_pages_nodemask+0x25b/0x280
[554545.805783] alloc_pages_current+0x6a/0xe0
[554545.805786] kmalloc_order+0x18/0x40
[554545.805787] kmalloc_order_trace+0x24/0xa0
[554545.805791] ? tcp4_gro_receive+0x10c/0x1b0
[554545.805792] __kmalloc+0x1dd/0x200
[554545.805811] bnx2x_frag_alloc.isra.50+0x28/0x40 [bnx2x]
[554545.805818] bnx2x_alloc_rx_data+0x45/0x1c0 [bnx2x]
[554545.805824] bnx2x_poll+0x90a/0x1870 [bnx2x]
[554545.805828] ? __update_load_avg_se.isra.38+0x1bc/0x1d0
[554545.805830] ? attach_entity_load_avg+0x4a/0x130
[554545.805833] net_rx_action+0x265/0x3a0
[554545.805835] ? pick_next_task_fair+0x15c/0x5b0
[554545.805838] __do_softirq+0x109/0x29b
[554545.805840] run_ksoftirqd+0x20/0x60
[554545.805842] smpboot_thread_fn+0x11a/0x170
[554545.805844] kthread+0x105/0x140
[554545.805845] ? sort_range+0x30/0x30
[554545.805847] ? kthread_create_worker_on_cpu+0x70/0x70
[554545.805848] ret_from_fork+0x35/0x40
Can anyone suggest a way arround?
Storage is CEPH and NFS
Thanks alot!
I'm having an issue regarding SWAP and RAM usage.
swappines is set to 1. My hosts are consuming alot of RAM, most is buffer/cache.
The Problem is the swap usage at 100%. This problem consists only on some hosts.
root@hp1s01:~# free -m
total used free shared buff/cache available
Mem: 386939 74277 3362 723 309298 309354
Swap: 1951 1951 0
If I clean the swap with
swapoff -a and swapon -a it looks OK for a while.
The the host starts again fillig up swap.
There is a call trace before the problem starts to come up.
[554545.805748] ksoftirqd/17: page allocation failure: order:2, mode:0x1084020(GFP_ATOMIC|__GFP_COMP), nodemask=(null)
[554545.805751] ksoftirqd/17 cpuset=/ mems_allowed=0-1
[554545.805757] CPU: 17 PID: 114 Comm: ksoftirqd/17 Not tainted 4.15.18-1-pve #1
[554545.805758] Hardware name: HP ProLiant BL460c Gen8, BIOS I31 05/21/2018
[554545.805759] Call Trace:
[554545.805770] dump_stack+0x63/0x8b
[554545.805773] warn_alloc+0xfc/0x190
[554545.805774] __alloc_pages_slowpath+0xefa/0xf10
[554545.805778] ? br_handle_frame_finish+0x2c3/0x450
[554545.805780] __alloc_pages_nodemask+0x25b/0x280
[554545.805783] alloc_pages_current+0x6a/0xe0
[554545.805786] kmalloc_order+0x18/0x40
[554545.805787] kmalloc_order_trace+0x24/0xa0
[554545.805791] ? tcp4_gro_receive+0x10c/0x1b0
[554545.805792] __kmalloc+0x1dd/0x200
[554545.805811] bnx2x_frag_alloc.isra.50+0x28/0x40 [bnx2x]
[554545.805818] bnx2x_alloc_rx_data+0x45/0x1c0 [bnx2x]
[554545.805824] bnx2x_poll+0x90a/0x1870 [bnx2x]
[554545.805828] ? __update_load_avg_se.isra.38+0x1bc/0x1d0
[554545.805830] ? attach_entity_load_avg+0x4a/0x130
[554545.805833] net_rx_action+0x265/0x3a0
[554545.805835] ? pick_next_task_fair+0x15c/0x5b0
[554545.805838] __do_softirq+0x109/0x29b
[554545.805840] run_ksoftirqd+0x20/0x60
[554545.805842] smpboot_thread_fn+0x11a/0x170
[554545.805844] kthread+0x105/0x140
[554545.805845] ? sort_range+0x30/0x30
[554545.805847] ? kthread_create_worker_on_cpu+0x70/0x70
[554545.805848] ret_from_fork+0x35/0x40
Can anyone suggest a way arround?
Storage is CEPH and NFS
Thanks alot!
Last edited: