Incorrect high value used RAM on node

[sand-max]

Hi guys!

On system show a lot of used RAM

root@pvenode6:~# free -m total used free shared buff/cache available Mem: 192086 101671 89251 189 1163 88919 Swap: 0 0 0




Really used ~20G
root@pvenode6:~# vmstat -s 196696928 K total memory 122194000 K used memory 20620628 K active memory 285468 K inactive memory 73564000 K free memory 57188 K buffer memory 881744 K swap cache 0 K total swap 0 K used swap 0 K free swap 20517602 non-nice user cpu ticks 344 nice user cpu ticks 12526104 system cpu ticks 1633689400 idle cpu ticks 533355 IO-wait cpu ticks 0 IRQ cpu ticks 1702144 softirq cpu ticks 0 stolen cpu ticks 3284582922 pages paged in 800069176 pages paged out 0 pages swapped in 0 pages swapped out 2365479364 interrupts 757786514 CPU context switches 1615461087 boot time 56909281 forks

 

[Dominic]

You have 122194000K used memory and 122194000/1024/1024 is about what the PVE GUI shows as RAM usage? And free shows about the same as used?

 

[sand-max]

You have 122194000K used memory and 122194000/1024/1024 is about what the PVE GUI shows as RAM usage? And free shows about the same as used?

I have 10 lxc are running there only, and each one usage about 128 MB, but summary OS shown 97 GB used






Active + Inactive = ~1.7Gb

@pvenode6:~$ vmstat -sSM
       192086 M total memory
        99538 M used memory
         1343 M active memory
          357 M inactive memory
        91510 M free memory

And I see by python script "ps_mem.py":

 

[Dominic]

Have you looked at buffer / cache?

 

[sand-max]

Have you looked at buffer / cache?

pvenode6:~# free -m
              total        used        free      shared  buff/cache   available
Mem:         192086      100441       90348         192        1296       90130
Swap:             0           0           0

 

[Dominic]

It should be interesting to compare the outputs to the content of /proc/meminfo (and also /proc/stat).

 

[sand-max]

It should be interesting to compare the outputs to the content of /proc/meminfo (and also /proc/stat).

root@pvenode6:~# cat /proc/meminfo
MemTotal:       196696932 kB
MemFree:        92518708 kB
MemAvailable:   92295560 kB
Buffers:           48216 kB
Cached:           920540 kB
SwapCached:            0 kB
Active:          1647500 kB
Inactive:         322080 kB
Active(anon):    1038156 kB
Inactive(anon):   173528 kB
Active(file):     609344 kB
Inactive(file):   148552 kB
Unevictable:      234632 kB
Mlocked:          234632 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                24 kB
Writeback:             0 kB
AnonPages:       1235568 kB
Mapped:           383068 kB
Shmem:            196444 kB
KReclaimable:     359256 kB
Slab:            7903332 kB
SReclaimable:     359256 kB
SUnreclaim:      7544076 kB
KernelStack:       19152 kB
PageTables:        17396 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    98348464 kB
Committed_AS:    4479260 kB
VmallocTotal:   34359738367 kB
VmallocUsed:     2028624 kB
VmallocChunk:          0 kB
Percpu:           125952 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
FileHugePages:         0 kB
FilePmdMapped:         0 kB
CmaTotal:              0 kB
CmaFree:               0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:     2954840 kB
DirectMap2M:    184385536 kB
DirectMap1G:    14680064 kB

root@pvenode6:~# cat /proc/stat
cpu  24566162 408 16969084 1993433311 624993 0 2340409 0 19795665 0
cpu0 440825 36 377420 49755615 15831 0 710550 0 315348 0
cpu1 498966 35 370763 49979414 15889 0 153120 0 381788 0
cpu2 825963 34 522564 49379358 14404 0 131644 0 576311 0
cpu3 593581 38 406328 49870352 14364 0 70225 0 503062 0
cpu4 544605 38 429219 49663907 15352 0 157245 0 457977 0
cpu5 594208 36 458617 49806671 13213 0 41223 0 496127 0
cpu6 583305 36 454888 49832459 13196 0 31177 0 490030 0
cpu7 588898 31 454778 49847340 14672 0 30625 0 499795 0
cpu8 541813 36 442556 49675101 15248 0 152917 0 451010 0
cpu9 672652 0 515572 49645359 14587 0 49824 0 572270 0
cpu10 556937 10 367845 49707725 18135 0 145409 0 452904 0
cpu11 466146 0 387930 49629152 17106 0 248801 0 361590 0
cpu12 575414 0 397591 49880316 16306 0 33467 0 466648 0
cpu13 568623 0 423493 49692367 17553 0 119980 0 441734 0
cpu14 645140 0 427987 49796961 15316 0 32586 0 525318 0
cpu15 677393 0 422231 49732733 15961 0 39380 0 559598 0
cpu16 672501 12 427629 49847772 15321 0 5559 0 559210 0
cpu17 678988 4 421261 49850488 15763 0 5280 0 564361 0
cpu18 680877 4 421883 49848601 14346 0 4941 0 566513 0
cpu19 682307 2 416530 49853837 14892 0 4848 0 569981 0
cpu20 630938 1 571540 49735587 12047 0 7587 0 382472 0
cpu21 689744 30 536896 49706500 14723 0 8484 0 338874 0
cpu22 602180 0 482496 49859705 15407 0 7285 0 499296 0
cpu23 639488 0 467731 49841864 15149 0 7618 0 545036 0
cpu24 618412 0 460810 49873740 15090 0 7349 0 520263 0
cpu25 608130 0 442169 49901330 16177 0 7860 0 508585 0
cpu26 609103 0 453206 49817460 12975 0 56420 0 515899 0
cpu27 597869 0 452977 49908098 12607 0 7846 0 505217 0
cpu28 618349 3 444794 49895400 14994 0 8052 0 525857 0
cpu29 731109 2 434374 49796482 15371 0 8206 0 624368 0
cpu30 781057 0 401391 49773080 18391 0 4336 0 665160 0
cpu31 653758 0 399287 49898039 22160 0 4305 0 544874 0
cpu32 600484 0 383349 49974532 15842 0 4354 0 490467 0
cpu33 622575 0 378355 49961536 14848 0 4295 0 514156 0
cpu34 588265 0 377558 49994300 16112 0 4477 0 476455 0
cpu35 593406 4 365752 49999633 21546 0 4599 0 485542 0
cpu36 573170 2 351680 50040502 15983 0 4497 0 465231 0
cpu37 551590 0 341118 50075046 15937 0 4520 0 448286 0
cpu38 561176 1 335909 50069487 16043 0 4630 0 453758 0
cpu39 606201 1 340589 50015441 16118 0 4870 0 474278 0
intr 8642138655 16 0 0 0 0 0 0 0 1 1021434 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 59 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 129586717 203263812 87533045 340126505 93451258 616559258 95045212 104046011 76348605 484261535 118831546 557284667 1068824648 88738604 474032289 62181637 102481801 9159120 8323303 7552368 7264423 32622919 31126052 32318953 33060454 33748496 33664164 34663362 34452883 35783956 34598617 6768844 6700866 6921515 6793145 6905498 6966316 7135530 7053145 7475541 7855318 290299 0 1450430 684564 597229 558552 547150 518672 496584 489971 799345 809857 492676 521089 587641 552099 530694 504984 497257 480786 488620 468058 759029 808930 765159 812711 712010 655693 631852 615191 564938 508752 457036 503976 544139 530028 520316 522422 506099 526882 513453 487731 2 0 2 23 0 2 2 2 2 2 2 2 0 2 0 2 2 2 2 2 2 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ctxt 19118674660
btime 1615461087
processes 65524415
procs_running 1
procs_blocked 0
softirq 7656927591 1 775831873 245060541 742647279 130099127 0 7755541 886700703 3557 573861673