Astro Lab Computers Running Out of Storage #6
Description
STEPUP_image_analysis takes the original dataset, which includes x raw science images plus 22 flat and bias calibration files and writes 3 new master calibration files plus x instrument signature removed science images. Then a new WCS information calibration file is saved and used to write x more instrument signature removed science images with WCS information and then x more are written with accurate WCS information.
In summary, an original dataset with 22 + x files in it ends up becoming a 26 + 4x dataset with 4 different kinds of science images.
The two intermediate kinds of science images are always removed after processing, but we have been keeping the raw science images and the ISR, accurate WCS science images. More and more data being obtained and processed has resulted in causing the error: OSError: [Errno 28] No space left on device: '/home/depot/STEPUP/raw/<name-of-target>/<date-of-observation>/ISR_Images/<filter-name>/WCS/accurate_WCS' when running the program because it cannot write any more files.
The amount of files in /home/depot/STEPUP/raw/ could be reduced by removing the raw science images as well, as the original files are also saved on the observatory computer, but then the file storage would have to be reconfigured, since it would not make sense to have some directories in raw contain raw science images and others contain ISR, accurate WCS science images.