Add CI tests with minimum dependencies #173
Description
We are not currently testing with the minimum dependencies listed in setup.cfg. Those test should be added so that we can make sure that the minimum versions listed are in fact compatible with the library.