This release is a major update to the Level 1 COMPASS-FME environmental sensor data, and also introduces a new Level 2.
Level 1
This is version 2-0 (codename “Liam”) of the Level 1 synoptic and TEMPEST sensor data. Level 1 data are close to raw but are units-transformed, have flags added, and include extensive metadata.
What’s New:
✅ Data files are now annual and single-variable, rather than monthly and multi-variable
✅ New F_MAD column identifies likely outliers
✅ New code examples, documentation improvements, and more
What’s Changed:
❗️ 478M data points from late 2019 through June 2025 for TEMPEST and all synoptic sites
❗️ Data plots now include out-of-bounds indicators, color, and informative axis labels
❗️ Many corrections to older data; see release notes. Special thanks to @Wilson, Stephanie here
Level 2
This is the first release (but v2-0 to stay in sync with L1; codename “Emilio”) of the Level 2 environmental sensor data. Compared to the L1 data, these data are more consistent; better QA/QC’d; more complete, with gap-filled time series available, and feature additional derived variables. L2 data intended to be rapidly and easily usable in analyses and simulations.
What’s New:
✅ 172M data points from late 2019 through June 2025 for TEMPEST and all synoptic sites
✅ Data are every 15 minutes, from 1 January 00:00 to 31 December 23:45
✅ Outliers, out-of-bounds, and out-of-service data are dropped
✅ Gap-filling via linear interpolation (small gaps) and mean annual cycle (longer gaps) is available
✅ New derived variables soil salinity and groundwater level; special thanks to @Regier, Peter @Machado da silva, Fausto @Sulman, Benjamin here
✅ Data are in Parquet, an open source, high performance file format that can easily be read by R, Python, etc.