Data Pipeline-in-a-Box (ELT)

Description

Ship a production-grade analytics stack fast. Includes:
• Ingestion templates (Airbyte/Singer) with incremental/full modes.
• dbt project (staging/intermediate/marts) + tests + macros.
• Airflow DAGs with SLAs, retries, alerting.
• Great Expectations suites, freshness checks, source audits.
• Cost-aware partitioning, SCD2 starter, late-arriving data patterns.
• Generated dbt docs + lineage; runbooks for ops.
Layers: Sources → Ingestion → Staging → dbt transforms → Warehouse → BI.
Works with BigQuery/Snowflake/Postgres; Looker/Power BI/Tableau ready.