data-pipeline-design
Design reliable batch or incremental ETL, ELT, or CDC pipelines before implementation, with explicit grain, idempotency, recovery, and reconciliation.
Pinned to revision 56bf813cab86, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/data-pipeline-design/SKILL.md
- skills/data-pipeline-design/references/incremental-loads.md
- skills/data-pipeline-design/references/parquet-storage.md
- skills/data-pipeline-design/references/postgresql-patterns.md
- skills/data-pipeline-design/references/reliability-patterns.md
Every link opens the file at its source, pinned to the revision this page describes.