Hi Everyone!
I've been having this weird issue with my LXC containers within proxmox getting max CPU, RAM, and SWAP usage after a while of running. I'm not really sure where to start debugging this, but I have a feeling it is because of Grafana Alloy.
I didn't have this issue till I had Grafana Alloy pushing data to Mimir and Loki. It happens on all virtual machines, ones with 1 core upto 8 cores, ones with 1gb of ram upto 8 gb of ram, ones with 512mb of swap all the way up-to 1gb of swap...
The LXC image I am using is Alma Linux 9.4.
A few questions,
How would I debug this assuming it's a memory issue with Grafana Alloy?
Has anyone else experienced this issue?
This is a screenshot of one of the VM's that failed after 10 days. The only way I can resolve this is by completely stopping the VM. I cannot login to it, I cannot do anything to it. This particular VM is running a reverse proxy, but it happens on VM's running anything. It seems like it happens on all of my VM's after a set period of time, not dependent on the amount of resources I've given to the VM.
I am running this on a ZFS raid between VMS, but VMS on the same ZFS raidpool does not fail at the same time.
I'm at a loss, not sure what to do or debug this other than knowing that it might be a memory issue with Grafana Alloy. Is there any possible way for me to figure this out and get more evidence so I can report it to the Grafana Alloy team?
Thanks in advance!
I've been having this weird issue with my LXC containers within proxmox getting max CPU, RAM, and SWAP usage after a while of running. I'm not really sure where to start debugging this, but I have a feeling it is because of Grafana Alloy.
I didn't have this issue till I had Grafana Alloy pushing data to Mimir and Loki. It happens on all virtual machines, ones with 1 core upto 8 cores, ones with 1gb of ram upto 8 gb of ram, ones with 512mb of swap all the way up-to 1gb of swap...
The LXC image I am using is Alma Linux 9.4.
A few questions,
How would I debug this assuming it's a memory issue with Grafana Alloy?
Has anyone else experienced this issue?
This is a screenshot of one of the VM's that failed after 10 days. The only way I can resolve this is by completely stopping the VM. I cannot login to it, I cannot do anything to it. This particular VM is running a reverse proxy, but it happens on VM's running anything. It seems like it happens on all of my VM's after a set period of time, not dependent on the amount of resources I've given to the VM.
I am running this on a ZFS raid between VMS, but VMS on the same ZFS raidpool does not fail at the same time.
I'm at a loss, not sure what to do or debug this other than knowing that it might be a memory issue with Grafana Alloy. Is there any possible way for me to figure this out and get more evidence so I can report it to the Grafana Alloy team?
Thanks in advance!