No module named 'catalogbuilder.tests.compval'

[aradhakrishnanGFDL]

Issue running catalogbuilder in my environment.

(catalogbuilder) a1r:/home/a1r/github/noaa-gfdl/CatalogBuilder/catalogbuilder/scripts> ./gen_intake_gfdl.py --config ../../configs/config-cmip.yaml
Traceback (most recent call last):
File "/home/a1r/github/noaa-gfdl/CatalogBuilder/catalogbuilder/scripts/./gen_intake_gfdl.py", line 10, in
from catalogbuilder.tests.compval import compval as cv
ModuleNotFoundError: No module named 'catalogbuilder.tests.compval'

[aradhakrishnanGFDL]

The catalogbuilder is also supposed to work outside of fre-cli by activating the catalogbuilder conda environment. My setup is now failing.

Can the following be used to catch exceptions for compval import and have the alternate way of running also possible without the conda installation?

try:
from catalogbuilder.intakebuilder import gfdlcrawler, CSVwriter, configparser, getinfo
except ModuleNotFoundError:
logger.warning("The module intakebuilder is not installed. Do you have intakebuilder in your sys.path or have you activated the conda environment with the intakebuilder package in it? ")
logger.warning("Attempting again with adjusted sys.path ")
try:
sys.path.append(os.path.dirname(os.path.dirname(os.path.abspath(file))))
except:
logger.error("Unable to adjust sys.path")
#print(os.path.dirname(os.path.dirname(os.path.abspath(file))))
try:
..

https://github.com/NOAA-GFDL/CatalogBuilder/blob/main/catalogbuilder/scripts/gen_intake_gfdl.py#L17

[Ciheim]

Have you updated your installed catalog builder package?

[aradhakrishnanGFDL]

Have you updated your installed catalog builder package?

The test case here is one without the conda package - just the conda env minus catalogbuilder package and the github repository.
I've pushed a change in 131-fix. You can try that, and extend, test further as needed.

[aradhakrishnanGFDL]

My fix will only be useful for my execution style. I think you have to import and catch the exception for the fall back just like the other imports in gen_intake_gfdl. This will allow fre-cli to be happy as well with your original way of importing packages. I also don't know how builderconfig was missed out.. so I removed that as well from the import lines.