Fabric Dataflows

Last modified by Dimitri Rupp on 2026/06/11 09:30

On this page

Fabric Dataflows

Fabric Dataflows

What: Dataflows Gen2 — modern, scalable ETL via Power Query in Fabric.
Strength: No-/low-code, native Lakehouse integration, incremental refresh.

What are Dataflows Gen2?

Dataflows Gen2 are a modern, scalable way to ingest, transform, and load data into Microsoft Fabric. They allow users to build reusable ETL pipelines using familiar Power Query experiences, while integrating natively with Lakehouse, Warehouse, and other Fabric destinations.

🔑 Key Features

Feature	What it gives you
Power Query Interface	Build transformations using a no-code or low-code experience, with full support for M language.
Direct Lakehouse Integration	Write output directly to Lakehouse tables in Parquet format, enabling seamless analytics and reporting.
Incremental Refresh	Filter out previously processed data — only new or changed rows are loaded on each refresh.

🧩 Common Use Cases

Loading structured data from SharePoint into Lakehouse
Transforming Excel-based reports into analytics-ready formats
Filtering and deduplicating data before ingestion
Automating daily refreshes for operational dashboards

Dataflow Gen2 vs. Pipelines vs. Notebooks

Orchestration type	Strength	When to use
Dataflow Gen2	Power-Query-Low-Code; Lakehouse-native	Strukturierte Ingestion aus SharePoint/Excel/APIs, einfache Transformationen
Data Pipeline	Native Fabric copy + transform; parametrierbar	Standard-DB-zu-Lakehouse-Bewegung, getriggerte Workflows
Notebook	PySpark / Python — volle Kontrolle	Custom-Logik, ML, komplexe File-Parsing, Spezialfaelle

flowchart LR
    SP[SharePoint Files / Lists] -->|Power Query| DF[Dataflow Gen2
M-language]
    XLS[Excel Reports] --> DF
    API[REST API / Board] --> DF
    DF -->|Parquet| LH[(Lakehouse
Bronze / Silver)]
    DF -->|incremental refresh| LH

    classDef src fill:#e3f2fd,stroke:#1976d2,stroke-width:1px
    classDef df fill:#fff3cd,stroke:#b85c00,stroke-width:1px
    classDef lh fill:#f4a261,stroke:#b85c00,stroke-width:1px,color:#000
    class SP,XLS,API src
    class DF df
    class LH lh

Real-world examples in SPL

get_Board_API — feeds board_bronze_lh (siehe Board Bronze Lakehouse)
SharePoint-File-Ingestion ergaenzt durch Notebooks fuer SharePoint Bronze Lakehouse

Fabric Dataflows

Fabric Dataflows

What are Dataflows Gen2?

🔑 Key Features

🧩 Common Use Cases

Dataflow Gen2 vs. Pipelines vs. Notebooks

Real-world examples in SPL

Related pages

Verwandte Themen