Search results

  1. damon1

    [SOLVED] Ceph Scrub Errors not going away.

    If any one else finds this or I need it again. run ceph osd repair all on any node. This will get rid of the scrub errors but you then need to tell ceph to forget about the errors and "revert" to a previous version It doesn't take too long to run and the log should show when it is finsihed...
  2. damon1

    [SOLVED] Ceph Scrub Errors not going away.

    ps this is the global configuration thanks
  3. damon1

    [SOLVED] Ceph Scrub Errors not going away.

    Yes all OSD's are up and running latest version = 14.2.4.1 the instructions i followed for cache teiring are from this page http://tacoisland.net/2019/01/06/hyperconverged-hybrid-storage-on-the-cheap-with-proxmox-and-ceph/ basically it sets up one rule for SSD and one for HDD ceph osd...
  4. damon1

    Question for new setup for small office

    My 2c (assuming you don't have 10's of thousands) get 3 servers and use Proxmox with a NAS as it will work fine over a 1GB network. Proxmox will give you HA if a server goes down and you can login to each store/site using the GUI to restart a VM or even reboot a node. In each server (node)...
  5. damon1

    [SOLVED] Ceph Scrub Errors not going away.

    HI All, simple set up 3 nodes each node has 1 SSD and 1 HDD connected via 10GB network. I stutdown (via GUI) and moved one node from one location to another with a down time of about 15 minutes. I had moved all the VM's from that node to other nodes. When I started the node it all seemed to...
  6. damon1

    [SOLVED] Ceph, create OSD and no disks unused (greyed out)

    worked for me again - lucky I put this here as I spent hours trying to figure it out again. try this ceph-volume lvm zap /dev/sdb for each disk you want to use reboot machine
  7. damon1

    CTs running but GUI shows red X - How do I get the GUI Back?

    If anyone else finds this - Proxmox 6.0 Log into the cluster that has all the nodes in green but one node in red click on the red node Click on system Check all the services are running. In-particular CronSync. Once I started that it added itself back to the Cluster in about 30 seconds. thanks
  8. damon1

    Best to ask first - Ceph network on 10GB or 1GB if that is all you have?

    thanks guys i will add a few 1GB cards to 2 of the boxes which will give me 1x 10 , 2x1GB in each box then " Have CEPH use the 10GBit network, no matter what. If possible give the Proxmox Cluster traffic (corosync) it's own 1GBit network and use the second 1GBit for the production traffic to...
  9. damon1

    cannot see the contents of my CEPH storage

    when i click on I get this the problem is The Public Network IP address is for another node (prox2) not for prox4 and shouldn't it be 10.10.10.0/24? :(
  10. damon1

    cannot see the contents of my CEPH storage

    I really wish I had found this FIRST I'm not a expert.. but you should: 1 - Stop/Out all OSDs 2 - Remove all OSDs 3 - Remove ALL Mons (except the master) 4 - Remove ALL Managers (except the master) 5 - Execute on each OSD node: pveceph purge 6 - On last node (master mon/mgr): stop all ceph...
  11. damon1

    Not able to use pveceph purge to completely remove ceph

    when i clicked on the link it took me to your last post so the below may not be useful at all, given the above. Hi Daniel, I have a similar problem in that I cannot get Ceph back to square one, which led me to your post. I am certainly no expert. Ceph is its own file system so you dont add it...
  12. damon1

    cannot see the contents of my CEPH storage

    OK - little harder than I thought. Is there a list of things to do to remove CEPH? I tried to remove all the monitors, OSD's etc.. pveceph purge sudo apt-get --purge remove ceph-base and a few other things i found on the internet but ceph is hanging in there. currently migrating and then...
  13. damon1

    cannot see the contents of my CEPH storage

    to be honest I am sure it is my fault but i cannot remember what I did. I am thinking about removing the ceph and rebuilding it with cache teiring as per these instructions. http://tacoisland.net/2019/01/06/hyperconverged-hybrid-storage-on-the-cheap-with-proxmox-and-ceph/ I have found speed to...
  14. damon1

    cannot see the contents of my CEPH storage

    Hi Thomas, I removed the prox4 monitor, should I remove it from the Manager and Metadata Server lists as well? thanks Damon
  15. damon1

    cannot see the contents of my CEPH storage

    Hi Thomas nothing in cephfs_metadata Yes there are 4 nodes in the cluster many thanks for the tip as well thanks damon
  16. damon1

    cannot see the contents of my CEPH storage

    Hi Thomas, here are the outputs, thanks damon
  17. damon1

    cannot see the contents of my CEPH storage

    done something bad again. -Prox 6.0.4 when I click on the contents button for my ceph storage all I get is this window appearing. rdb list shows me this any ideas what I have done? The ceph itself works fine for storage. thanks damon
  18. damon1

    [SOLVED] Can you use Ceph as a storage for VM's disk image files?

    post any hints you find once you are done, would love to know what I can do to improve anything. thanks again damon
  19. damon1

    [SOLVED] Can you use Ceph as a storage for VM's disk image files?

    Hi All, either I have mucked up something or I have the wrong information. I have created a 3 node CephFS and i can upload ISO's to it but I cannot createe a VM and use it for the disk image. I thought Ceph could be used for disk images? Am I wrong? If not then is there someway to add "disk...