Skip to content

iowarp/clio-data

v1.0.0BSD-3-Clause

The clio-data agent's plugin: its mission, assess-data-quality (what a variable states, checks, comparisons, visual checks) and convert-scientific-data (the HDF5/ADIOS2 to Parquet dtype map, skip-or-ask rules, and a bundled converter that reads back and verifies rows, nulls, NaNs, dtypes and per-column checksums).

GitHub
skills

assess-data-quality

Judge whether variables in HDF5, netCDF-4, ADIOS2 or Parquet files can be trusted and compared - what a variable states about itself, the checks to run with bounded reads, how to compare two variables, and which visual checks reveal problems.

Read SKILL.md at the source

Pinned to revision 458d7da9d653, so it is the text this page describes rather than whatever the author pushed since.

Files

Every link opens the file at its source, pinned to the revision this page describes.