Plugin Registration Performance

### Describe

There are many ways to do plugin registration, and we are likely not using the most efficient method

https://packaging.python.org/en/latest/guides/creating-and-discovering-plugins/#using-namespace-packages

Further, I don't think we are making the best use of pluggy

### Specification

_No response_

### Dependencies

_No response_