iowarp/clio-data
v1.0.0BSD-3-Clause
The clio-data agent's plugin: its mission, assess-data-quality (what a variable states, checks, comparisons, visual checks) and convert-scientific-data (the HDF5/ADIOS2 to Parquet dtype map, skip-or-ask rules, and a bundled converter that reads back and verifies rows, nulls, NaNs, dtypes and per-column checksums).
scripts
- convert-scientific-data
- scripts/convert_to_parquet.py
plugin.json
- name
- clio-data
- version
- 1.0.0
- description
- The clio-data agent's plugin: its mission, assess-data-quality (what a variable states, checks, comparisons, visual checks) and convert-scientific-data (the HDF5/ADIOS2 to Parquet dtype map, skip-or-ask rules, and a bundled converter that reads back and verifies rows, nulls, NaNs, dtypes and per-column checksums).
- author
- IoWarp Team
- license
- BSD-3-Clause
- extensions
- ai.iowarp.clio
plugin.json
{
"$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
"name": "clio-data",
"version": "1.0.0",
"description": "The clio-data agent's plugin: its mission, assess-data-quality (what a variable states, checks, comparisons, visual checks) and convert-scientific-data (the HDF5/ADIOS2 to Parquet dtype map, skip-or-ask rules, and a bundled converter that reads back and verifies rows, nulls, NaNs, dtypes and per-column checksums).",
"author": {
"name": "IoWarp Team"
},
"license": "BSD-3-Clause",
"keywords": [
"hdf5",
"adios2",
"parquet",
"conversion",
"data-quality"
],
"extensions": {
"ai.iowarp.clio": {
"requires": [
"data-onboarding",
"hdf5",
"adios",
"parquet"
]
}
}
}
What else this package ships
These files come with the package and this site does not publish them. They are listed so you know what is there before you install it.
- convert_to_parquet.py
Client extensions
Data this package carries for particular clients. The directory lists the clients named and never reads what is addressed to them.
- ai.iowarp.clioships a directory of files