...on the setup and deviating from the official documentation,
I usually employee the Networkmanager, but instruct that one to only manage the Wifi interface.
nmcli device set <physical_interface_names> managed false
For me this usually works much smoother, especially with constantly changing...