Update data set creation routine

[aknierim]

Maintenance

• Add a complete rewrite of dataset creation routine pyvisgen.simulation.data_set.SimulateDataSet
  • Accessible using a classmethod to load a config file
  • Add optional multithreading support
  • Draw and fully test parameters before simulation loop. Previously this was done in the loop and tests were only performed for two time steps
  • Support for polarization
• Add new default config file for new dataset creation routine
• Update CLI tool for dataset creation routine
• Allow passing HDF5 key in pyvisgen.utils.data.open_bundles
• Restructure pyvisgen.gridding module by adding a utils submodule that contains all utility functions that previously were in the gridder submodule
  • Also fix parts of the utility functions
• Update and fix tests

New Features

• Add new gridder that can handle vis data returned by the vis_loop

[codecov]

Codecov Report

Attention: Patch coverage is 82.19178% with 78 lines in your changes missing coverage. Please review.

Project coverage is 81.08%. Comparing base (c1169d1) to head (b9106e9).

Files with missing lines	Patch %	Lines
pyvisgen/gridding/utils.py	44.33%	59 Missing ⚠️
pyvisgen/simulation/data_set.py	92.99%	11 Missing ⚠️
pyvisgen/gridding/gridder.py	83.33%	6 Missing ⚠️
pyvisgen/simulation/scan.py	0.00%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #53      +/-   ##
==========================================
- Coverage   90.40%   81.08%   -9.32%     
==========================================
  Files          19       23       +4     
  Lines        1219     1602     +383     
==========================================
+ Hits         1102     1299     +197     
- Misses        117      303     +186     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[aknierim]

Okay, this apparently opened a box of pandora coverage-wise :D