ram usage with bluestore

Discussion in 'Proxmox VE: Installation and configuration' started by Stefano Giunchi, Mar 2, 2019.

  1. Stefano Giunchi

    Proxmox Subscriber

    Joined:
    Jan 17, 2016
    Messages:
    36
    Likes Received:
    1
    this is my test cluster:
    node A: n.3 filesystem 1TB OSDs
    node B: n.2 filesystem 1TB OSDs, n.1 bluestore 1TB OSDs,
    node C: n.6 bluestore 300GB OSDs

    I noticed that bluestore OSDs take 3.5GB of RAM each, while the fileystem ones take 0.7 GB each.

    Following this thread, I added this to ceph.conf:

    Code:
    [osd]
    bluestore cache size = 1G
    Now everything is ok, but is this the right thing to do? Or bluestore OSDs take as much RAM as is available, but releases it if needed?
     
  2. sg90

    sg90 Member

    Joined:
    Sep 21, 2018
    Messages:
    50
    Likes Received:
    7
    filestore can use the system page cache so the ram use you see is only what the OSD requires to operate.

    With bluestore it can’t use the page cache for caching so has its own inbuilt ram cache.

    The value you set will be used as an aim to keep the operation ram and the cache ram within target, you will want to set this as close to the default which is 4GB per OSD as you can to allow space for caching.

    If 1GB is the best you can do without hitting swap (which will just have a negative impact) then leave it at this.
     
  3. Stefano Giunchi

    Proxmox Subscriber

    Joined:
    Jan 17, 2016
    Messages:
    36
    Likes Received:
    1
    thank you for the info.
     
  4. sb-jw

    sb-jw Active Member

    Joined:
    Jan 23, 2018
    Messages:
    483
    Likes Received:
    41
    https://ceph.com/releases/v12-2-10-luminous-released/
     
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice