Search results

  1. M

    Ceph cannot specify wal/ db

    Hi, Im adding OSDs to my ceph clusterusing the command below, however it say that there are incompatible values which is not what is specified here https://docs.ceph.com/en/latest/rados/configuration/bluestore-config-ref/ . Am i understanding something wrong? im using ceph version 18.2.4...
  2. M

    Reducing Ceph Write Latency

    I have a 16 X 1 TB ceph cluster over 4 nodes and my write latency is kinda slow. I already have the db and wal on a separate SSD, Separate networks for the front and backend. How do I get the write latency to less than 16 ms? Other than going to full SSD cluster ofc. Ping results Backend: 1...
  3. M

    How to recover from 100% disk use

    Hi guys, I did an oopsie. I set up a new PBS server and forgot to configure a GC and a retention policy(I have one on pve), now the disk is at 100% full how do I get the GC to run now that its giving me a disk full error. TASK ERROR: update atime failed for chunk/file...
  4. M

    Adding a Node to ceph tanks performance

    I had a 3 node cluster where the command rados bench -p scbench 10 write --no-cleanup gets the following results after adding another node however the results seem to have tanked. I can obviously see the cur MB/s had a sharp drop, however Im not sure what is the issue and not even sure how...
  5. M

    Unable to start Ceph

    Hi, I just did a hard disk swap and all the osds on a node is not able to start with the service `systemctl start ceph-osd@0` the output of systemctl status ceph-osd@0 is ceph-osd@0.service - Ceph object storage daemon osd.0 Loaded: loaded (/lib/systemd/system/ceph-osd@.service...
  6. M

    Replace 3TB drive with 1 TB drives (Ceph)

    My ceph cluster has 3 3TB and 3 1TB drives with SSD WAL and DB. The write speeds are kinda meh on my VMs, from what I understand the 3 TB drives will get 3x the write request of the 1TB drives. Is my understanding correct ? and would it be better if I swapped my 3TB with 1TB drives making it 2...
  7. M

    What is 4/CPUs per year

    I run proxmox with low powered nodes in my home lab, Looking at the licences its by cpu does this mean that if i buy the 4cpu subscription i can run it on 4 hosts 1cpu each? or does that mean I can run it on 1 host with 4 cpu (if that even exists) and also can I mix nodes such as 1 2-cpu node...
  8. M

    How to move vm config from deleted node?

    I did an oopsie while upgrading my node and forgot to move my templates over from the old node. I already deleted the old node so i cant just use the UI trying to copy the file over gets me this root@pve2:~# cp /etc/pve/nodes/pve3/qemu-server/1000.conf...
  9. M

    How to change ceph Internal cluster network

    as the title suggest, how do I change ceph's internal cluster network? I just added a faster NIC and can't figure out how to get the cluster to change network
  10. M

    Ifup breaks network connection

    Hi, this is the first system that I have multiple network cards on so this might be absolutely my fault/ misunderstanding. So I have the initial config vmbr0 iface vmbr0 inet static address xx.xx.xx.xx/24 gateway xx.xx.xx.xx - this gateway can access the internet...
  11. M

    VM for app with licence tied to hard disk

    I have a stupid proprietary app that's running on an old windows server 2009 and it ties it's licence key to the hard disk how do I migrate this server thats in questionable health to my current PVE setup?
  12. M

    [BUG] Similar SSD not showing up in installer 8.0-2

    Hi, I'm in the process of upgrading one of my nodes. When trying to install PVE 8.0 I realized that in the setup menu the installer does not see my 2nd SSD. Downgrading to the 7.1 installer sees the disk just fine. Feel free to ask for logs or any other things
  13. M

    What is "Normal" Ceph performance?

    As the title suggests, I wanna find out what are the performance of other people's clusters. I'll start: Node Count: 3 Networking: 1 gbe shared with proxmox Disks: 3 x 3TB 7200RPM 2 x 1TB 7200RPM 1 x 1TB 5400RPM using this Benchmarking Tutorial here's my result
  14. M

    Adding Erasure Coded Pool

    according to this thread its not possible to add an EC pool with the ceph UI yet, is there a roadmap for this to happen or is it going to be a CLI only thing?
  15. M

    Docker with PVE Ceph

    Hi guys, as the title suggests I'm trying to get docker volumes to be stored on ceph that is integrated with proxmox. As far as I've seen the proxmox integrations does not have NFS support (correct me if I'm wrong). I'm on ceph pacific moving to quincy and PVE 7.4.3. Is there a supported way to...
  16. M

    How to move VMs from 1 installation to another?

    Hello guys, I have a test pve 7 system that's kinda borked. I have a cluster that's working, if I wanted to move the VMs over from the test system to the working cluster what do I need to clone over? Thanks.
  17. M

    [TUTORIAL] How To Get and use PVE Tickets

    So I had a project where I needed to login with username and password instead of a Token and I could not find any documentation. I spent around an hour looking thru the perl API (I do not code in perl so the syntax was totally alien to me) so I thought I would share it for other. Firstly we...
  18. M

    Cannot Access proxmox via VPN (openvpn)

    Hi Ive recently setup a Openvpn server to manage my proxmox instance without opening it up to the internet however im unable to access proxmox via either webgui or ssh my Network is setup as pfSense 172.16.1.1 proxmox 172.16.1.2 ubuntuserver 172.16.1.3 openvpn "endpoint" (what my ip will be...
  19. M

    Ceph pool config

    Hi I currently have a pool of 3 1TB OSDs across 3 nodes Im planning to add 3 3tb hard disk and I was wondering if I should start a new pool with the 3tb hdds or add it to the existing pool I only know that If I add to the pool depending on how I adjust the weights I either trade IO or capacity
  20. M

    Poor WebGUI/Network performance with intel I219-V

    Hello, I have 3 servers pve1 running a Xeon 2670v3 X99(C612) platform and a realtek nic lspci 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller and 2 more (pve2 and pve3) running a pentium just for ceph nodes However the...