What about general USB to serial adapters? These should only be listed with serial numbers, not as a general USB to material adapter. And the software could propose a udev rule with serial number if access failed.