Hi everyone,
thanks a lot for the detailed feedback and for digging into this further.
We now have two full backup days completed with:
iscsi_tcp.recv_from_iscsi_q=Y
enabled, and so far we have not seen any of the previous iSCSI NOP timeout...
Ok @huganega , I think we've figured this out. It takes a combination of things to trigger:
- A link that's "fast" (i.e., 25GbE) relative to your CPU (Skylake or Cascade Lake)
- A backup load running at full queue depth
- An array that doesn't...
Good morning, everyone!
Lots of learning available from this forum thread, what a journey, Werner! You have a lot of patience and dedication to follow through with this troubleshooting. Very good sleuthing on BBGeek's part here, it makes sense...
Hi @huganega,
FWIW, what you're describing looks familiar. We ran into something very similar a while back, and it turned out to be an awkward corner of the iSCSI protocol where neither side is obviously wrong, yet they still stall each other...
Today we are really excited to celebrate 20 years of Proxmox Server Solutions. When Dietmar and I founded Proxmox 20 years ago, our vision was clear: to create efficient and easy-to-manage Linux software solutions for everyone. Looking back, it's...
Thanks Aaron, thanks Longer,
That's exactly the kind of feedback I was hoping for when I posted.
PVE Mirror now has its own subsection now under Related Proxmox software, next to PBS, PMG and PDM. I also added a line to the history section...
Great work.
I have just quickly skimmed through the Wikipedia page. I don't see wrong or misleading info in the storage section.
My 2 cent for addition if possible (I am not familiar with contribution to wikipedia):
- Mention to Proxmox Offline...
Hi Everyone,
After reading through BBGeek's tutorial earlier today about LVM-Thin, I was inspired to share an educational article I recently published on my blog. The article explores Mac OS X Snow Leopard Server, a remarkable operating system...
Hi Everyone,
Every few months someone asks some version of "why can't I use LVM-thin on my shared SAN LUN?" Thick LVM works fine as shared storage, but has no native snapshots. LVM-thin has snapshots but is local-only... it's natural to wonder...
Hi Everyone,
As Proxmox VE has grown quite substantially since I began using it, I thought I'd blend together my Wikipedia editing with my in-depth knowledge of the software and my general awareness of the company behind it. Having received the...
Im going to take the weekend to check some of this out and digest it a bit.
So far since the GUI crashes I haven't touched my storage at all and we've been 100% stable which is great though I am at a point where I need to either adjust or create...
Hi Huganega,
Ok, that 128/128 result is probably the most interesting thing you've found yet. The fact that the active SCSI path reaches exactly 128 outstanding requests, stops completing them for 12-14 seconds, and then sdk_ioerr_cnt increases...
Thanks for the links. I have looked into both of them in more detail now.
The fleecing patch is interesting because it demonstrates that a QEMU block-drain condition can indeed leave guest I/O stuck if the drained section is not terminated...
Hey Frankz,
Realtek cards "work" on most Linux hosts, but server admins don't trust them due to well-earned stigma. NICs are very affordable, I have a pile of them. But an I340-T4 for under $40 CAD or PRO/1000 4 Port for the same price will be...
Hey NoriCopperBrand,
Good news, nothing wrong with your equipment! In other news, you are in for some pleasant learning. First major thing: Do not run these commands on every PVE node:
rescan-scsi-bus.sh
multipathd resize map mpathX
pvresize...
Virtual machine support is better classified first by CPU architecture rather than by the guest OS itself. At this point, the relevant architectures are x86 and ARM.
The next question is whether the guest OS supports the virtual hardware...
Hi Frankz,
Ok, now I understand, thank you. Yes, in studying those CPUs, I can see clearly that three of them would offer you a substantial upgrade:
Host CPUCores / threadsTurboTDPPassMark CPU MarkSingle-thread bench
i7-97008 /84.7 GHz65...
If you want to repair the original installation, I would first inspect the old disk from the new Proxmox install before making any changes.
For example, check whether the old root filesystem, /boot, and VM configuration files are still present...
Hi Frankz,
Wow what a mishmash of random computers you have. I don't quite understand your problem, however. What is it you're looking for someone to advise you on? The storage, the CPU specs? If it's a laboratory, the best thing is to...
In the past, we did the same, but with thick-LVM of all storage space and use the ZFS-over-iSCSI appliance for all stuff, that needs a snapshot. We migrated the VM online to the other storage, did the intended stuff and migrate it back.
IIRC...