Search results

  1. D

    API returns 500 but no logs

    @dcsapak So that looks like the crux of it. Passing rootfs: local-zfs:5 seems to be doing the trick. The interesting part is that apparently I've been using it wrong for 7+ years but it worked all the way until now as non-root. I have to say, the documentation for rootfs parameter...
  2. D

    API returns 500 but no logs

    @oguz I've made a few important discoveries. First, I realized that PVE API returns error message in the "status line" of HTTP response. That was my mistake to not realize it earlier and to be honest, I've never seen an API server actually do that before. Therefore, I kept being confused by...
  3. D

    API returns 500 but no logs

    Yes, nodes were all rebooted after upgrade to PVE7. Not all nodes were rebooted after latest minor kernel update, I doubt that matters. I've also tried rebooting the node in question, which did not help. What's new is that prior to installing latest set of updates yesterday and prior to...
  4. D

    API returns 500 but no logs

    The request is sent from a nodejs app via HTTPS API remotely. There is nothing in journal related to that request. However, I am certain it is reaching that server since pveproxy on it shows the request in the access log. The versions are all the same, all latest:
  5. D

    API returns 500 but no logs

    Hello, I seem to have an unusual problem which happened shortly after upgrading to PVE 7. I have an application which creates LXC containers on a PVE cluster over API. Recently, it started getting 500 status code in response to POST /api2/json/nodes/node1/lxc. The response body does not have...
  6. D

    Unable to create OSDs in new Proxmox/Ceph cluster - RADOS object not found (error connecting to the cluster)

    It looks like both the symlink shown by @victorhooi AND installing apt install python3-distutils are needed to make out-of-the-box Ceph on Proxmox actually work flawlessly.
  7. D

    [SOLVED] Imported CT doesn't start: Failed to mount "/dev/pts/8" onto "/dev/console"

    I had the same exact problem. My error exactly: Turns out the container was configured with eth0 using vmbr1, which didn't exist and should be vmbr0 instead. Upon changing the network setting, the container started up immediately with no errors. It appears the error message is very misleading.
  8. D

    ZFS rollback stuck in 'D' state

    I will keep an eye on this report and add my setup if it happens again. So far it only happened once after 90 days of uptime and we use bult-in PVE replication a lot (every 15 minutes for many LXC containers) using ZFS send/receive of course.
  9. D

    ZFS rollback stuck in 'D' state

    I seem to have a similar issue but the stack looks like this: root@ex1:~# cat /proc/1005172/stack [<0>] taskq_cancel_id+0xdb/0x110 [spl] [<0>] zfs_unlinked_drain_stop_wait+0x47/0x70 [zfs] [<0>] zfsvfs_teardown+0x25/0x2f0 [zfs] [<0>] zfs_suspend_fs+0x10/0x20 [zfs] [<0>]...
  10. D

    net.bridge.bridge-nf-call-iptables and PVE Firewall

    The rules do compile. Everything is applied fine from PVE side of things. I can see the rules configured in iptables, nftables, ipset, etc. The only problem is that the kernel does not even process packets through them because of net.bridge.bridge-nf-call-iptables=0. There should be a mechanism...
  11. D

    net.bridge.bridge-nf-call-iptables and PVE Firewall

    I enabled it at all those levels and set the rules at the VM level. There are other rules set at other levels but I'm not expecting those to apply now.
  12. D

    net.bridge.bridge-nf-call-iptables and PVE Firewall

    @mira The firewall rules are obviously configured via the PVE web interface, it is the PVE firewall after all. If bridge-nf-filter-vlan-tagged doesn't get set then the setup I described above wouldn't have firewall operational. However, I queried the status of all those sysctl settings and...
  13. D

    Can't update centos7 (or install httpd) in unprivileged LXC container.

    Thanks, this worked for filesystem-3.2-21.el7.x86_64 on CentOS 7.
  14. D

    net.bridge.bridge-nf-call-iptables and PVE Firewall

    In most cases where IPs are routed through the PVE host, the bridge-nf-call-* settings do not need to be enabled for PVE Firewall to work. However, we have recently switched to using a vlan-aware bridge on the host and configure the VLAN ID directly in Proxmox for each container/VM interface...
  15. D

    Proxmox Crashing on Hetzner Server with Intel I219-LM NIC

    You can easily ask for a 3 hour KVM access and send them a link to ISO to be burned on flash drive and attached. They'll happily do that every time for free, that's how I always install my Proxmox servers.
  16. D

    Operational issues with ZFS and pvesr

    Ever since Proxmox 6 came out, we moved towards using Proxmox with ZFS across all physical servers. That is because with the new corosync, we don't need to have multicast traffic between those servers. We have successfully virtualized servers that were previously on bare metal and even started...
  17. D

    Critical ZFS crash: VERIFY3(0 == dmu_object_claim_dnsize(zfsvfs->z_os... failed (0 == 28)

    We just experienced a nasty crash whenever kernel touched our ZFS pool. This occured after we replaced one faulty drive and resilvered but in fact had nothing to do with that. The crash bug occurs when ZFS is trying to reapply ZIL due to a previous power loss. The issues linked below document...
  18. D

    [SOLVED] [OVS] veth shows NO-CARRIER on LXC start

    Thanks @Alwin for the pointers. It turns out that the behavior is isolated to the latest Archlinux template that PVE downloads. On Ubuntu it works fine, therefore it's not OVS/host network problem.
  19. D

    [SOLVED] [OVS] veth shows NO-CARRIER on LXC start

    Is there a way I need to "initialize" tag (4001) in OVS specifically? It's true that I don't use this tag on the host, it's only for the instances in this case. I'll bring up an interface on the host with that tag to give it a try. EDIT: No, adding an interface (vlan4001) on the host and having...
  20. D

    [SOLVED] [OVS] veth shows NO-CARRIER on LXC start

    The problem is that when starting LXC container first time, creating LXC container OR after PVE host is rebooted (and therefore OVS configuration is reset, since PVE does not use persistent OVS DB), the virtual interface plugged into OVS port (vmbr0 here with VLAN tag 4001) does not work. Here...


The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!