Skip to content
#

metadata-driven-pipelines

Here are 4 public repositories matching this topic...

Accelerator for building a modern Microsoft Fabric data platform with reusable components and an ELT orchestration framework. Automates up to 80% of Bronze and Silver layer processing, so you can focus on business insights in the Gold layer.

  • Updated Jan 11, 2026
  • Jupyter Notebook

End-to-end backend and data hub architecture on Azure, integrating Databricks and a suite of Azure services for seamless data processing, analytics, and deployment.

  • Updated Feb 1, 2025
  • Jupyter Notebook

End-to-end Metadata-Driven Data Engineering framework built on Azure. Features dynamic SQL/REST API ingestion with range pagination, automated schema mapping, and event-driven orchestration. Implements robust CI/CD via GitHub Actions/YAML and automated failure alerting with Logic Apps. Optimized for scalability and DE best practices.

  • Updated Jan 16, 2026

Designed a production-grade Azure Data Engineering project centered on Azure Data Factory. Built dynamic, metadata-driven pipelines to ingest data from on-prem systems, REST APIs, and Azure SQL into ADLS Gen2 using Medallion Architecture, incremental loading, and enterprise-scale orchestration patterns.

  • Updated Jan 13, 2026

Improve this page

Add a description, image, and links to the metadata-driven-pipelines topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the metadata-driven-pipelines topic, visit your repo's landing page and select "manage topics."

Learn more