spillwavesolutions/data-engineering-knowledge-capture
Data Engineering Knowledge Capture: schemas, lineage, medallion, semantic models, and glossary into a durable OKF knowledge graph. Multi-host bindings and write isolation.
Promote tables/views to business objects with glossary definitions.
Capture SQL or DAX query artifacts.
Capture a table with columns, layer, schema into DEKC/OKF.
Build progressive-disclosure context packs for a data concept.
Use the DEKC second brain to design a new report/dashboard from existing metrics, gold tables, business objects, and glossary.
Capture Mermaid or PlantUML diagrams (architecture, component, activity, state, class, ERD, sequence) and PlantUML wireframes for reports/dashboards into the DEKC second brain.
Author glossary terms linked to business objects.
Grade reverse-engineering quality with automated rubric scores and adversarial judge protocol. Use after walks, before claiming RE complete.
Refresh, inspect, or drop the disposable SQLite/FTS5 knowledge index. Use when search/pack is slow, after a large git checkout, or when the user asks about the DEKC index.
Scaffold a DEKC knowledge bundle with medallion catalogs.
Use the DEKC second brain to plan landing new stream or batch data into bronze (and beyond) with sources, jobs, contracts, and lineage.
Extract and materialize data lineage paths and mermaid diagrams.
Breadth-first reverse-engineering plan — map scan roots and optional exports, rank focus areas, emit deep-dive checklists. Pause here before spawning specialists. Not query-time retrieve.
Capture data lakes, data marts, data catalogs, domains, products, streams, storage locations, and data quality rules into the DEKC second brain.
Query-time DEKC retrieval. Spawn data-retriever; parent gets a summary card only. Use for Table, Metric, LineagePath, IngestionJob, Transformation, Dashboard, DataProduct, GlossaryTerm, BusinessObject questions.
Full-text search over the DEKC knowledge bundle (AND terms, type filters). Use when finding tables, lineage, or metrics by keyword.
Query the DEKC OKF second brain with design intents (reports, land data, metrics, impact). Uses standard concept schemas under schemas/okf-concepts/.
Capture semantic models, metrics, dashboards, reports.
Open or close an isolated second-brain write session (worktree + PR). Use before writing knowledge when multiple agents share one knowledge remote.
Walk a data lake/warehouse filesystem or ingest Fabric/Power BI inventory JSON into DEKC.