Search results

  1. D

    Activate Ceph Object Storage

    That's block storage. Ceph Luminous is capable to function as an object storage, via web API (RADOS Gateway), similar to Amazon S3, Swift... Oficial Ceph tutorial to configure block storage can be found here and here. Is there a way, to activate it in a Proxmox Ceph Cluster and transform a...
  2. D

    Ceph recommendation

    I don't like the idea to use the OS drive also for OSD's journal. if you loose the SSD, you loose everything, OSD's, server in the proxmox cluster.. To "move" the journal from it's own HDD drive, you must remove and create the OSD with the new structure. In theory you can do that for each OSD...
  3. D

    Ceph recommendation

    it is mandatory to choose the value of pg_num because it cannot be calculated automatically. Here are a few values commonly used: Less than 5 OSDs set pg_num to 128 Between 5 and 10 OSDs set pg_num to 512 Between 10 and 50 OSDs set pg_num to 1024 If you have more than 50 OSDs, you need to...
  4. D

    Ceph recommendation

    PG Calc recommends pg size, 512. 9 OSD's, Size 3, 100% Data integrity, Target PG / OSD 200 Wrong pg size cand generate performance issue. You can increase this number but you can't go back without destroing the pool and loose data. Increasing pg size is creating a storm in your cluster and...
  5. D

    Ceph recommendation

    What is the number of pg-s and size/min in the pool you are using?
  6. D

    Ceph recommendation

    We run 8 nodes, each node has two 2TB HDD OSD/s (16 HDD OSD) with journal on an Intel DC SSD, 2Gbps Ceph Network, latest version of Proxmox and Ceph. Performance and redundancy is more than OK. Last benchmark looks like this. WRITE Total time run: 60.614986 Total writes made: 2627 Write size...
  7. D

    Activate Ceph Object Storage

    Hello, community. Is there a way to activate and use Ceph Object Storage in a Proxmox Ceph Cluster? Thanks
  8. D

    Ceph recommendation

    Try to increase the read ahead for the osd's hdd. It is possible to gain a bit of speed on read... echo "2048" > /sys/block/sda/queue/read_ahead_kb Also, in ceph.conf osd max backfills = 1 osd recovery max active = 10 PS: How many HDD-OSD do you have? What is the ceph network speed? Have...
  9. D

    VZDump slow on ceph images, RBD export fast

    We just upgrade (fresh install) to the latest version our Proxmox VE 5.034 cluster. Everything looks great, the new Proxmox and Ceph Luminous works well except for one thing. The well known slow vzdump legacy. We run a 8 nodes Ceph cluster as VM storage and 5 nodes Proxmox compute nodes. The...
  10. D

    proxmox 5 ceph osd create

    Did you know, https://pve.proxmox.com/wiki/Ceph_Server#Ceph_on_Proxmox_VE_5.0 If you need to roll out now please install Proxmox VE 4.4 with Ceph Jewel and make a inplace upgrade to Proxmox VE 5.0 later, when Ceph Luminous is stable. In Proxmox VE 5.0 the only available Ceph version is...
  11. D

    VZDump slow on ceph images, RBD export fast

    Same problem also here. I didn't know that the problem is so old and I opened another thread here, with my info.
  12. D

    Proxmox VE Backup Speed (vzdump) on NFS server

    Hello everyone, We are using virtual servers with large drives, so large that a backup is taking more than 24 hours. I wonder if there is a way to increase the backup speed. Configuration is a Proxmox VE Cluster 4.4.13, VM storage is a 7 node (2 osd each node with Intel SSD DC Journal) Ceph...
  13. D

    [SOLVED] Issues getting Proxmox 4.4 + Ceph Jewel running

    Disabled, like "#deb https://enterprise.proxmox.com/debian jessie pve-enterprise". Now I get it. Proxmox is not in the default Debian repo. Thanks for the answer.
  14. D

    [SOLVED] Issues getting Proxmox 4.4 + Ceph Jewel running

    Indeed, but command "pveceph install --version jewel" (error was mention above) was not working with the default repository (pve-enterprise repository disabled), even after dist-upgrade. When I add the pve-no-subscription repo, things start working. PS: On pveceph install (without --version)...
  15. D

    [SOLVED] Issues getting Proxmox 4.4 + Ceph Jewel running

    I see. Thought it was a confusion with the topic about "just do dist-upgrade" and it works. Better said, do the dist-upgrade if you have the enterprise repository added. :)
  16. D

    [SOLVED] Issues getting Proxmox 4.4 + Ceph Jewel running

    I just added in /etc/apt/sources.list # PVE pve-no-subscription repository provided by proxmox.com, # NOT recommended for production use deb http://download.proxmox.com/debian jessie pve-no-subscription And guess what? It's working. Unfortunately, the enviroment I'm trying to setup is for...
  17. D

    [SOLVED] Issues getting Proxmox 4.4 + Ceph Jewel running

    Same problem here. And this after a fresh install of proxmox. Disable the enterprise repo in /etc/apt/sources.list.d/pve-enterprise.list apt-get update && apt-get dist-upgrade -y I get, root@ceph07:~# pveceph install --version jewel 400 Parameter verification failed. version: value 'jewel'...
  18. D

    pveproxy problem after adding a new node

    We shut down all nodes. Power off all of them. Started one by one. All OK now. What on earth happend? PS: VNC Console is disconnecting randomly...
  19. D

    pveproxy problem after adding a new node

    We rebooted each node, cluster is out. Some virtual machines are working, some are not.
  20. D

    pveproxy problem after adding a new node

    Hello, everyone. We encounter a problem when we add a new node to our cluster. All pveproxy refuse to work on all nodes. root@prox249:~# service pveproxy status ● pveproxy.service - PVE API Proxy Server Loaded: loaded (/lib/systemd/system/pveproxy.service; enabled) Active: failed...