@kiwi
Have you been able to solve this in any way? We have the exact same problem with our serial device which gets registered as xhci_hcd, and no ttyUSB* device is added when plugging in the device. I have tried all of the USB ports, getting the same result.
We have tried to move the dtoverlay=dwc2,dr_mode=host line to be included under the [all] line as @smieschek suggested.
Everything is working perfect when running a RBPi3 running emteria.OS v7.3.0 but not with our RBPi4 running emteria.OS v11.3.0.
Does anyone have an update on this?