Search results

  1. T

    Create a Zram is good for my case?

    Hi, I have a 3 node clusters using x3650 m5 servers, and I am running out of disk slots, therefore, last week, I setup a zfs two SDs by using SD adaptor came with the server, SD speed is low but working fine. Today I noticed there some IO delay and slow writing response time on SDs (I guess...
  2. T

    [SOLVED] two identical IT raid card, how do I know which is which when pass through

    Hi, I have two IT raid cards, one is pci 8, other is pci9, when I am passing through one of card to a vm, how do i know which is which? IOMM number is smaller one I assume is the one on pci8? please kindly advise.
  3. T

    [SOLVED] upgrade a raid card, do I need to reinstall OSD disks?

    Hi, Currently I have a proxmox node, it has a raid card which was setup as JBOD, and I have 2 OSD disks on it. I want to change this raid card to IT card, my question is how to handle my existing two OSD disks? 1. I could, before I swap this raid card, destroy these two OSD disks, and...
  4. T

    what a "pool read bandwidth" tell you?

    Hi, I am using zabbix to monitor ceph, and I am trying to monitor "pool read bandwidth", but I am not sure the number is making any sense. I have a pool that have 12 OSDs (all ssds), my reading is "290314427384832", my questions are: 1. what is unit for this number? bytes/s or bits/s? 2. what...
  5. T

    Zabbix / Ceph ssd pool write bandwidth reading

    Hi, I have a 5 node cluster, and running ceph on them, and I have 18 ssd (enterprise ssd) osds. I created a testing pool on it, called "test1283". Zabbix reports [test1283]pool write bandwidth is 16.23 Tbytes (no way this high), and when I ran rados test on this pool (command like "rados -p...
  6. T

    [SOLVED] Adding multiple osds to a ceph cluster

    Hi, I have a proxmox cluster with 6 nodes, and have ceph running on it with 2 osds at each node. I want to add one extra osd at each node. My question is: After I added an osd, should I wait for the whole ceph rebalanced first, then adding 2nd osd, and so on? Thanks.
  7. T

    Failed tasks still shown after 30 days

    Hi, I have a PBS working for over a year now, and I just set up Zabbix to monitor this PBS, and on PBS GUI, there is no failed tasks shows for last 30 days, but in Zabbix items, it shows a failed tasks warning, I know 2 months, there were some failed backups, and I would assume PBS will clear...
  8. T

    [SOLVED] missing file /ect/apt/sources.list.d/pve-install-repo.list

    Hi, I am upgrading my proxmox from 7to8, I think some how I am missing file /ect/apt/sources.list.d/pve-install-repo.list, no sure why? is this important for me to upgrade from 7to8? please advise. thanks in advance. In stead, I have this line "deb http://download.proxmox.com/debian/pve...
  9. T

    [SOLVED] VM restore to cause disk full - how to cli command to stop restore and delete this vm?

    Hi, Yesterday I started a vm restore to local-zfs disk, and this morning I found that this node fell out of cluster, and I only can access by ssh. The disk is full, and cause this node hang. This vm is not important, how can I stop the restore, and delete this vm to free up disk space? thanks.
  10. T

    [SOLVED] how to change proxmox boot from grub to uefi

    Hi, I just upgrade my proxmox server to a new hardware IBM x3650-M5, I used same proxmox boot disk from the old system (older hardware, so it was boot from grub). I have to use legacy bio boot in order to be able to boot from the disk. Here is output for "proxmox-boot-tool status"...
  11. T

    how to LSI port mapping to each disk

    Hi, I have a PBS setup and running just fine, but yesterday I had a disk failed, but realized I do not know how to find that which slot is my failed disk to be replaced. The failed disk shown as sdh (which is the last disk in GUI screen), so I assume that is the last disk #4 (I only have 4...
  12. T

    OSD apply & commit latency spikes

    Hi, I have 8 nodes HA system, ceph running on 6 nodes with 12 osd. Once a week, I will see a spike in OSD apply & commit latency max reading (see attached picture), wondering how to trouble shoot it, which node and which osd causing this? Any help would be much appreciated.
  13. T

    issue with special device setup

    Hi, As per attached zpool status -v output, I have few questions on how to setup a mirrored special device for pool name "Charlie-Backup", here what I did: 1. original, I was able to setup a mirror-1 special device by sdd and sde (both are ssd). 2. then I want to change sdx to disk-id...
  14. T

    [SOLVED] How to move old backup to a new special device

    Hi, I setup a new ssd as a special device to my backup server storage pool, and I had some old backup on the storage pool (all spin disks before), how to rewrite these old backup and so new meta data can be written onto that ssd special device? thanks in advance.
  15. T

    [SOLVED] setup a new ssd and move mega data to that ssd

    Hi, I had a pbs running with 4 sas disk drives, and GC takes 7 days to complete. After some reading, I think to setup a new ssd storge and use it for all mega data, that would speed up GC process. move backup mega data to ssd, so GC will be faster. Anybody could suggest how to move mega data...
  16. T

    can proxmox 8 version work on E5-2643 V2

    Hi, Currently I am running Proxmox 7 on 5 node cluster, I have E5-2643 V2 for cpus, wondering can I safely upgrade to proxmox 8 on my machines? I am thinking to upgrade my machines in 3 years (will have E5 V3 cpus), do you think I can keep my old cpus for at least 3 years? Thanks.
  17. T

    [SOLVED] Issue with a spikes in OSD apply latency max

    Hi, I have 8 nodes HA system, ceph running on 6 nodes with 12 osd. Once a week, I will see a spike in OSD apply latency max reading (see attached picture), wondering how to trouble shoot it, which node and which osd causing this? Any help would be much appreciated.
  18. T

    How to trouble shoot this [WARN] PG_AVAILABILITY: Reduced data availability:

    Hi, I have a 6 nodes proxmox HA setup, and with ceph running / 18 ssd osds. I get following warning often, not sure how to trouble shoot, possible: 1. which osd causing this warning? 2. which node causing this warning? 3. this warning is due to ssd disk? or could be something to do with...
  19. T

    new sas disk can not get GPT initialized

    Hi, I installed a new sas 12tb disk, but I can not get it initialized, give me error and task fail. I used smartctl -i /dev/sdx to check it and compare the result with a existing and working disk, I found the new disk was formated with type 2 protection, but my old working disk does not. I...
  20. T

    [SOLVED] setting up UTM vm wan port and vpn

    Hi, I am setting up a vm for UTM, and I assigned two bridge vmbr0 and vmbr8 (with two separated nic) to this vm, and vmbr8 shows up in vm as eth1, and I set it up as a wan port in UTM, question: I am trying to setup an openvpn on this UTM, when I login through a vpn from outside, traffic will...