Search results

  1. S

    Question on Datacenter Summary vs Datacenter Ceph Usage Discrepancy

    I'm curious why the difference here? 86TB of Summary Storage, but Ceph Usage shows 120TB total. Ceph is much closer to the original full raw amount of data from all the drives. The amount used also in the Summary seems far too high as well. and
  2. S

    How to remove Ceph safely from 1 node?

    I just wipe em with gdisk >> x >> z >> y >> y then reboot and it will lose the label. If that's what you're referring too
  3. S

    Question on Ceph and CephFS - Advice.

    So are you saying just create a vm disk and mount it in the VM? My current approach is to do that and then rsync the data onto it from a NAS. Feels kludgey but maybe it's the right way? Then use docker to access the volume from the VM.
  4. S

    How to Add/Detach Hard Disk via Command Line?

    Great post. I needed the same thing today with a very large disk I didn't want to backup either.
  5. S

    Ceph, Pools, PGs, and OSDs - Should I Change These?

    Ehhh screw it, I'm going in. HDD to 512 NVMe to 256 SSD remains 128 Will increment by 128 to get the desired count and see what happens. o_O
  6. S

    Ceph, Pools, PGs, and OSDs - Should I Change These?

    Hello, I am trying to understand how to optimize my ceph pools and understand how to associate pgs to pools correctly. I have the following. 12 OSDs in HDD pool in 3 hosts 9 OSDs in NVMe pool in 3 hosts 3 OSDs in SSD pool in 3 hosts Each one is a 3/2 with a default of 128 PGs if I used this...
  7. S

    [SOLVED] Specific Question on Ceph and OSDs from Compute Hosts

    I have been tooling around quite a bit with Ceph and Proxmox the last few weeks, and really, it is pretty awesome. It's really taken my lab of a mix mash of machines and hosts, and made them somewhat valuable again and much easier to manage my needs and experiments. I mean it's another level of...
  8. S

    [SOLVED] Host >> Disk >> Usage >> Incorrect (LVM instead of Ceph OSD)

    There are 6 nvme OSDs that were created, then afterwards using the cli the class was set to nvme, after they were initially created as SSD by defauled so unset and set those 6. There are 3 however that I added and were defaulted to blank, as I disabled update per some guides I found. Those I...
  9. S

    How to Test Proxmox Email Notifications?

    im looking for more of a way to test the notifications that should fire from the service. Mail works fine from cli.
  10. S

    [SOLVED] Host >> Disk >> Usage >> Incorrect (LVM instead of Ceph OSD)

    I messed around with creating new classes and rules and such which works great. But in the Host >> Disk >> Usage it's not showing the correct usage for the nvme drives: It should show osd.20: Host1 >> Ceph >> Configuration item osd.20 weight 0.909
  11. S

    Problem Migration VM

    The HA works great!
  12. S

    Problem Migration VM

    This was my fault. The HA Group wasn't the same as the host I was migrating from so it kept failing back to the group it was a part of.
  13. S

    Problem Migration VM

    I have a VM on pool-ssd on node HP1 that is 20GB. I am trying to migrate this VM when it's off, to host1 and to pool-ssd disk. The migration starts with this message: Then I see the VM appear briefly on host1, then it disappears and goes back to hp1. There's nothing in the logs that I can...
  14. S

    Question on Ceph and CephFS - Advice.

    I am currently using ceph and have a few pools that use RBD storage type. One of these pools is rather large and responsible for holding onto media only, or will be. This has 10s of thousands of pictures, videos, music. Should I create a cephFS fs on the large media disks? I'm not sure how or...
  15. S

    [TUTORIAL] Ceph - Classes, Rules and Pools

    Index: 1. Create Classes 2. Crushmap 3. Creating Rules 4. Adding Pools -------- Piecing together information i've obtained from various threads, thought I'd compile it here for hopefully, easier consumption and use. If you're visiting this topic you probably already know what ceph is and what...
  16. S

    How to Test Proxmox Email Notifications?

    Is there a service or something simple I can intentionally break to trigger an email notification to be sent out?
  17. S

    Monitor/Manager/Metadata Nodes? How many? Where?

    Hello. I have the following: 5 hosts total 3 data/compute nodes (4x10TB OSD (CEPH), NVMe VMs, 64GB RAM 8c/16c) machines 10GBe 2 4c/8t 16GB RAM nodes with a local SSD also on 10GBe but no local ceph disks 1. Can I just put manager/metadata/monitor on the 2 smaller machines and be good or does...
  18. S

    [TUTORIAL] Get Postfix to Send Notifications (Email) Externally

    I'm not sure I did this in the proxmox way but I couldn't get email to relay to me and some posts were dated or didn't work for me, so I did the following: Gmail for example: Change /etc/postfix/main.cf to include/change these lines: relayhost = [smtp.gmail.com]:587 smtp_use_tls = yes...
  19. S

    [SOLVED] Faulty Disks / Missing OSDs

    Is it possible one of the HBA cards is bad and that causes ceph to freak out as disks are coming in and out or flopping? Are there any disks not on an HBA that can be pooled and tested? Are the same drives consistently complaining? Can you replace the drives that are reported as bad or move them...