Search results

  1. L

    [SOLVED] Remote server doesn't deduplicate

    I found that the garbage collection job wasn't running. Fixed that and now all is well!
  2. L

    [SOLVED] Remote server doesn't deduplicate

    I have setup a remote server in a different city to which I ship all backups using a sync job. The remote PBS datastore however doens't seem to be doing deduplication. The local PBS. Usage : 91.02% (3.97 TB of 4.37 TB) Backup Count CT : 32 Groups, 380 Snapshots Host : 0 Groups, 0...
  3. L

    pvesh and how to list API endpoints

    I had used https://pve.proxmox.com/wiki/Proxmox_VE_API#Using_.27pvesh.27_to_Access_the_API, which bascially just touches on the how to use pvesh. However, I have now found https://pve.proxmox.com/pve-docs/api-viewer/, which actually documents the whole API. I think it would be a good idea to...
  4. L

    pvesh and how to list API endpoints

    I have seen a couple of blogs out there that claim one can simply use the pvesh command without any parameters and it will drop into an interactive mode where one can show the calls that can be done and a particular level. It doesn't work like that for me though and the documentation is really...
  5. L

    Use API to get storage location for VM's

    Here is what I ended up doing: #!/bin/bash if [ -f vms.config ]; then rm vms.config fi echo 'node,type,name,cores,memory,disk1,virtio1,scsi0,scsi1' >vms.config for i in $(pvesh get /nodes/ --noheader --output-format json|jq -r '.[] .node') do for j in $(/usr/bin/pvesh get /nodes/$i/qemu...
  6. L

    Use API to get storage location for VM's

    So, I have created a basic script to list the storage locations for virtual machines on my Proxmox clusters. I will expand this to include lxc as well, but for now I'm just trying to learn how jq achieves this. #!/bin/bash #IFS=$'\n' rm qemu.config touch qemu.config for i in $(pvesh get /nodes/...
  7. L

    [SOLVED] Not able to retrieve disk' aio information via API

    How did you change the Token permission? I've using pvesh to query the machines configs, but I feel like I'm fumbling around in the dark.
  8. L

    Use API to get storage location for VM's

    Thanks, that gives me a good idea on how to do this. However, it seems that that my pvesh is somehow deficient. When I do: ~# pvesh get config node/vm No 'get' handler defined for 'config' also, I can't enter just ~# pvesh ERROR: no command specified Although that should allow me to browse...
  9. L

    Remote PBS log shows error, but all processes look completed

    Can anyone see what causes this error? 2023-12-18T13:00:07+02:00: percentage done: 98.18% (54/55 groups) 2023-12-18T13:00:07+02:00: sync group vm/199 2023-12-18T13:00:07+02:00: re-sync snapshot vm/199/2023-11-20T08:36:28Z 2023-12-18T13:00:07+02:00: no data changes 2023-12-18T13:00:07+02:00...
  10. L

    Use API to get storage location for VM's

    Could you point in the right direction with the config of each VM? There doesn't seem to be a way to query that via the API, is there? Or did you mean I should use the config file for that VM and get it with bash and grep or something like that?
  11. L

    Use API to get storage location for VM's

    I need to extract which storage is assigned to each VM and LXC in our cluster. I can retrieve the total allocation for the boot disk, but can't see an obvious way to get the detail for each storage volume allocated. Some of our VM's have a boot disk on an ceph SSD pool and a logging disk on...
  12. L

    Strange disk behaviour

    Here's what my drives report: # nvme id-ns -H /dev/nvme0n1 | grep "Relative Performance" LBA Format 0 : Metadata Size: 0 bytes - Data Size: 512 bytes - Relative Performance: 0 Best (in use) I used that man page to create a special rbd volume for small writes to see if it improves the...
  13. L

    Strange disk behaviour

    If the problem only occures with ceph storage, then I would suspect that my ceph may not be able to handle it. But the intel-ssd is not a ceph volume and it happens there as much as it does on ceph storage. The poller writes many small files quite often. I'll forward some sample and a...
  14. L

    Strange disk behaviour

    I found rbd migration prepare. However # rbd migration prepare --object-size 4K --stripe-unit 64K --stripe-count 2 standard/vm-199-disk-0 standard/vm-199-disk-1 give me an error: 2023-11-22T13:04:18.177+0200 7fd9fe1244c0 -1 librbd::image::CreateRequest: validate_striping: stripe unit is not a...
  15. L

    Strange disk behaviour

    More than that, can I create a ceph rbd pool that has a 4096 block size as well, for this type of virtual machine? I don't see any parameter in the pool creation process that would allow me to set that. I do have this is my ceph.conf [osd] bluestore_min_alloc_size = 4096...
  16. L

    Strange disk behaviour

    We have done some more experiments with settings. If I increase the CPU's on this machine to 30, the problem of "D" state processes waiting for the disk practically goes away. However, while this may be a partial workaround, the problem is still that the CPU usage is way too high. The process...
  17. L

    Disk errors on FreeBSD 12.2 guest

    This problem has been re-occuring repeatedly... new thread here
  18. L

    Strange disk behaviour

    Yes, this has been an ongoing problem. When we moved the storage to non-ceph lvm-thin storage, the problem seemed to go away. However, after a couple of weeks it started re-occuring exactly in the same way that it was on ceph rbd storage. There's no specific time. We have had a completed...
  19. L

    Strange disk behaviour

    Reading the whole tread will be helpful. The nvme1 is part of a ceph pool, but the problem occurs regardless of which pool the VM uses, even if I move it to a local ext4 lvm-thin volume, the problem still occurs. Many other virtual machines are using that pool and they don't have any issues.
  20. L

    Strange disk behaviour

    I changed the thread name to better describe the issue.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!