ceph

  1. CEPH resilience: self-heal flawed?

    Hi, i'm exeriencing a strange behaviour in pve@6.1-7/ceph@14.2.6: I have a Lab setup with 5 physical Nodes, each with two OSDs. This is the Ceph Config + Crushmap: Config: [global] auth_client_required = cephx auth_cluster_required = cephx auth_service_required = cephx...
  2. CEPH cluster hangs. PLEASE HELP! URGENTLY!

    Hello, everybody! Serious trouble. `ceph status` hangs, every ceph command hangs! PVE shows "got timeout" reinstalled the node, tried to join the node just by copying keys, but could not create monitor (error: monitor existed), then I removed the monitor from monmap, and that's it all...
  3. [SOLVED] Ceph : delta in reported total space

    Hello, We now have a well working Ceph cluster with 5 nodes (PVE5.4, Ceph luminous). OSDs are distributed like this : * host1 : osd.12 : 1750 GB osd.13 : 1750 GB * host2 : osd.0 : 894 GB osd.1 : 1750 GB * host3 : osd.5 : 1750 GB * host4 : osd.4 : 1750 GB osd.5...
  4. Configuration suggestion for Proxmox + CEPH

    Dear friends, I have a question on assembling a Proxmox + CEPH (I am a newbie in Proxmox... but a have experience in use VMWare) cluster with 7 servers. My servers are a bit old, HPE DL360 and DL380 both generation 7 with P410i RAID controller (SAS 6Gb/s) that does not allow passthrough mode, ie...
  5. Backup Configuration

    Hey Guys, We have a cluster with 5 servers which is setup with High Availability for the VPS's... My only problem now is backups... I need to get a backup solution for the VPS's, so I was hoping to add 1 8TB drive to one of the servers, internal or external, and share it for all to make their...
  6. CEPH 4k random read/write QD1 performance problem

    Hi After days of searching and trying different things I am looking for some advice on how to solve this problem :). The performance issue persists in the VM's on Proxmox. They have some old software running on them that requires good random 4K read/write performance and this therefore has a...
  7. File system in VM

    I am trying to decide between using XFS or EXT4 inside KVM VMs. My goal is not to over-optimise in an early stage, but I want to make an informed file system decision and stick with that. Situation: Ceph as backend storage SSD storage Writeback cache on VM disk No LVM inside VM CloudLinux 7...
  8. Caching mode for Proxmox VE and Ceph.

    With colleagues, we have been using Proxmox VE for a long time. We want to implement Hyper-Converged Infrastructure (HCI). I read about caching modes in the official documentation https://pve.proxmox.com/wiki/Performance_Tweaks I would like to hear an authoritative opinion. What caching mode...
  9. TwiX

    CEPH : SSD wearout

    HI, My 'oldest' prx ceph cluster is based on samsung SM863a drives. After 3 years, wearout for some drives is less than "88% remaining". I don't know if these values are safe enough. Under what kind of Wearout value it is recommended to change the SSD drive ? Thanks !
  10. ceph - configure second public network

    i have a ceph setup, that is working. i want to connect another another network ( to the cephfs storage) is it possible? what is the best approach? the cpeh is proxmox based (over 40GB network) , the the clients are standalone desktop computers (over 1 gb network)
  11. [SOLVED] Latest Ceph release 14.2.7

    Hi, can you please confirm when the latest Ceph release 14.2.7 is available? Regards Thomas
  12. Proxmox external Ceph Disk Cache remommendation

    Hello, I searched this forum and google but i cannot find the final aswer.. We have a Proxmox cluster with a remote Ceph Luminous cluster. I see i get muge faster writes with Cache=writeback in the disk options in Proxmox, (random 4k up to 16x faster and Seq 10x faster) then with cache=none...
  13. [SOLVED] WebUI reports error in Ceph-Log: unable to open file - No such file or directory

    Hi, I get this error in WebUI - Ceph - Log on any node: unable to open file - No such file or directory Which logfile is WebUI trying to open here? THX
  14. pveceph createosd - Error: any valid prefix is expected rather than ""

    Hello all, I have a couple of separate Proxmox clusters using Ceph, and both won't allow me to create OSDs at the moment: # pveceph createosd /dev/sdd Error: any valid prefix is expected rather than "". command '/sbin/ip address show to '' up' failed: exit code 1 Testing 'ip address show'...
  15. proxmxo managed cephfs mount on external computer (non porxmox) cant access file content

    i have usefully integrated ceph(proxmox based) in all the lxc containers, now i want to integrate it outside of proxmox for some user for read only access , to replace the current nfs share, what do i need to do ? what params to put in /etc/fstab
  16. Proxmox Ceph Cluster Configuration

    Hi all, I read a lot of documentation about Proxmox Ceph Cluster but I can't figure out the best solution for my case. I would like to configure a little 3 node cluster using Proxmox and Ceph with the ability of add in the future more nodes (so more CPU and RAM to the cluster) if needed or...
  17. Disk migration from to Ceph storage occupies the maximum capacity configure for the disk at once

    I have one issue... When I migrate a VM's disk from one Ceph storage pool size 2 to another Ceph storage pool size 3 it occupies the maximum capacity configure for the disk in the target Ceph storage, despite the real use of that disk is only a few gigabytes. The attached images are very...
  18. [SOLVED] Can not create OSD for ceph

    Can not create OSD for ceph. Same error in GUI and terminal: # pveceph osd create /dev/nvme0n1 Error: any valid prefix is expected rather than "". command '/sbin/ip address show to '' up' failed: exit code 1 The only thing i can think of is since last time it worked was that i now have two...
  19. Proxmox6 vzdump tar failing with Ceph

    We are seeing intermittent vzdump tar failures for LXCs hosting Postgres and ArcGIS applications. It appears the tarball is failing while attempting to tar runtime/temporary application files. The error message produced reads, "Cannot stat: Structure needs cleaning". The host filesystem...
  20. [SOLVED] Lastest Ceph release 14.2.6 to fix MGR bug

    Hi, can you please comment by when you will release latest Ceph 14.2.6? This is a hotfix release primarily fixing a regression introduced in v14.2.5, all nautilus users are advised to upgrade to this release. Notable Changes --------------- * This release fixes a `ceph-mgr` bug that caused...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!