Skip to content

luynoxrd/lakehouse-agent-skills

v1.0.0MIT

Data-engineering skills and subagents for AI coding agents: profile before you clean, clean before you chart, persist to columnar storage, query it with SQL, then build the dashboard by BI rules rather than by the model's guess, and disclose exactly what was and was not processed rather than invent it.

parquet-to-open-table-format

Decides when a directory of Parquet files has stopped being enough to hold a dataset, by naming what that layer cannot do, from correcting a row to surviving two writers, keeping a column somebody added, or giving a reader the same answer twice. Use when files are being rewritten to fix rows, when more than one process writes the same dataset, when a column was added and the older files do not have it, or when a reader needs the data as it stood at a point in time.

Read SKILL.md at the source

Pinned to revision 7ff6aeac96ad, so it is the text this page describes rather than whatever the author pushed since.

Files

Every link opens the file at its source, pinned to the revision this page describes.