Wiki source code of Lakehouse-Architektur
Last modified by Dimitri Rupp on 2026/06/11 09:30
Hide last authors
| author | version | line-number | content |
|---|---|---|---|
![]() |
1.1 | 1 | {{box cssClass="floatinginfobox" title="**Contents**"}} |
| 2 | {{toc/}} | ||
| 3 | {{/box}} | ||
| 4 | |||
| 5 | = ๐ง Fabric Lakehouse = | ||
| 6 | |||
| 7 | {{info}} | ||
| 8 | A **Lakehouse** in Microsoft Fabric is a unified data architecture that merges the scalability of a data lake with the structure and performance of a data warehouse, offering a single platform for storing, managing, and analyzing structured and unstructured data. | ||
| 9 | {{/info}} | ||
| 10 | |||
| 11 | == ๐๏ธ Storage == | ||
| 12 | |||
| 13 | Data is stored in **Delta tables**, which support ACID transactions, schema evolution, and time travel. A Lakehouse contains two zones โ **Tables** and **Files**. | ||
| 14 | |||
| 15 | * **Tables** โ managed Delta tables with full metadata support | ||
| 16 | * **Files** โ unmanaged storage for raw data (CSV, Parquet, images, etc.), accessible via Spark but not queryable via SQL endpoint unless converted to Delta | ||
| 17 | |||
| 18 | == ๐ Transformation == | ||
| 19 | |||
| 20 | **Dataflows Gen2**, **Notebooks** (PySpark / Spark SQL), and **Pipelines** enable ingestion, cleansing, and transformation. These tools integrate natively with Lakehouses for modular, reproducible workflows. | ||
| 21 | |||
| 22 | == ๐ Access == | ||
| 23 | |||
| 24 | Lakehouses expose a **SQL endpoint** for T-SQL queries. Access is governed via **Microsoft Entra ID**, with support for workspace roles, item-level permissions, and Service Principals for secure external automation. | ||
| 25 | |||
| 26 | == ๐๏ธ Layers in our architecture == | ||
| 27 | |||
| 28 | The SPL Fabric architecture follows the **medallion pattern** with three layers: | ||
| 29 | |||
| 30 | {{mermaid}} | ||
| 31 | flowchart LR | ||
| 32 | SRC[๐ Source Systems] --> B[๐ฅ Bronze<br/>Landing zone] | ||
| 33 | B --> S[๐ฅ Silver<br/>Transformation] | ||
| 34 | S --> G[๐ฅ Gold<br/>Business-ready] | ||
| 35 | G --> CONS[๐ Consumers<br/>Power BI / Excel / Board] | ||
| 36 | |||
| 37 | style B fill:#cd7f32,color:#fff | ||
| 38 | style S fill:#c0c0c0,color:#000 | ||
| 39 | style G fill:#ffd700,color:#000 | ||
| 40 | {{/mermaid}} | ||
| 41 | |||
| 42 | * [[Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.WebHome]] โ landing zone with raw data from source systems | ||
| 43 | * [[Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]] โ transformation zone, cleaned and enriched data | ||
| 44 | * [[Gold Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Gold-Lakehouse.WebHome]] โ business-ready datasets for reporting and analytics | ||
| 45 | |||
| 46 | For detailed access instructions, see [[Get data from Lakehouse>>doc:IT-Wiki.02-Tools.Fabric.Get-data-from-Lakehouse.WebHome]]. | ||
| 47 | |||
| 48 | == ๐ Source-specific Bronze Lakehouses == | ||
| 49 | |||
| 50 | The Bronze layer is split into individual Lakehouses per source system: | ||
| 51 | |||
| 52 | * ๐ป [[BMD Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.BMD-Bronze-Lakehouse.WebHome]] โ data from BMD | ||
| 53 | * ๐๏ธ [[Rimo Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Rimo-Lakehouse.WebHome]] โ data from Rimo DWH | ||
| 54 | * ๐ง [[Board Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Board-Bronze-Lakehouse.WebHome]] โ data from Board (via Gen2 Dataflow) | ||
| 55 | * ๐๏ธ [[H3A Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.H3A-Bronze-Lakehouse.WebHome]] โ data from H3A | ||
| 56 | * ๐ [[SharePoint Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.SharePoint-Bronze-Lakehouse.WebHome]] โ data from SharePoint files | ||
| 57 | |||
| 58 | ---- | ||
| 59 | |||
| 60 | == Verwandte Themen == | ||
| 61 | |||
| 62 | {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}} | ||
| 63 | |||
| 64 | ---- | ||
| 65 | **Status:** Migriert โ Team-Review ausstehend ยท **Owner:** //(festlegen)// ยท **Letzter Review:** 2026-06-11 | ||
| 66 |
