Skip to content

Implement data compression for ADIOS2 snapshots #177

@ia267

Description

@ia267

Current implementation writes uncompressed data, leading to large file sizes that can impact storage requirements

Implementation details:

  • Add compression configuration options to the checkpoint namelist - see ADIOS2 docs
  • Implement support for different compression methods (ZFP, SZ, MGARD)
  • Add lossy vs. lossless compression options with configurable accuracy
  • Optimise compression settings for different data types

Acceptance criteria

  • Significant reduction in file sizes
  • User configurable compression settings via input file
  • Minimal impact on I/O performance
  • Documentation of compression options and their effects
  • Verification that compressed data maintains required accuracy

Metadata

Metadata

Assignees

Labels

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions