Wiki source code of Lakehouse-Architektur
Version 1.1 by Dimitri Rupp on 2026/06/11 09:16
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | {{box cssClass="floatinginfobox" title="**Contents**"}} | ||
| 2 | {{toc/}} | ||
| 3 | {{/box}} | ||
| 4 | |||
| 5 | = 💧 Fabric Lakehouse = | ||
| 6 | |||
| 7 | {{info}} | ||
| 8 | A **Lakehouse** in Microsoft Fabric is a unified data architecture that merges the scalability of a data lake with the structure and performance of a data warehouse, offering a single platform for storing, managing, and analyzing structured and unstructured data. | ||
| 9 | {{/info}} | ||
| 10 | |||
| 11 | == 🗄️ Storage == | ||
| 12 | |||
| 13 | Data is stored in **Delta tables**, which support ACID transactions, schema evolution, and time travel. A Lakehouse contains two zones — **Tables** and **Files**. | ||
| 14 | |||
| 15 | * **Tables** — managed Delta tables with full metadata support | ||
| 16 | * **Files** — unmanaged storage for raw data (CSV, Parquet, images, etc.), accessible via Spark but not queryable via SQL endpoint unless converted to Delta | ||
| 17 | |||
| 18 | == 🔄 Transformation == | ||
| 19 | |||
| 20 | **Dataflows Gen2**, **Notebooks** (PySpark / Spark SQL), and **Pipelines** enable ingestion, cleansing, and transformation. These tools integrate natively with Lakehouses for modular, reproducible workflows. | ||
| 21 | |||
| 22 | == 🔐 Access == | ||
| 23 | |||
| 24 | Lakehouses expose a **SQL endpoint** for T-SQL queries. Access is governed via **Microsoft Entra ID**, with support for workspace roles, item-level permissions, and Service Principals for secure external automation. | ||
| 25 | |||
| 26 | == 🏗️ Layers in our architecture == | ||
| 27 | |||
| 28 | The SPL Fabric architecture follows the **medallion pattern** with three layers: | ||
| 29 | |||
| 30 | {{mermaid}} | ||
| 31 | flowchart LR | ||
| 32 | SRC[📂 Source Systems] --> B[🥉 Bronze<br/>Landing zone] | ||
| 33 | B --> S[🥈 Silver<br/>Transformation] | ||
| 34 | S --> G[🥇 Gold<br/>Business-ready] | ||
| 35 | G --> CONS[📊 Consumers<br/>Power BI / Excel / Board] | ||
| 36 | |||
| 37 | style B fill:#cd7f32,color:#fff | ||
| 38 | style S fill:#c0c0c0,color:#000 | ||
| 39 | style G fill:#ffd700,color:#000 | ||
| 40 | {{/mermaid}} | ||
| 41 | |||
| 42 | * [[Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.WebHome]] — landing zone with raw data from source systems | ||
| 43 | * [[Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]] — transformation zone, cleaned and enriched data | ||
| 44 | * [[Gold Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Gold-Lakehouse.WebHome]] — business-ready datasets for reporting and analytics | ||
| 45 | |||
| 46 | For detailed access instructions, see [[Get data from Lakehouse>>doc:IT-Wiki.02-Tools.Fabric.Get-data-from-Lakehouse.WebHome]]. | ||
| 47 | |||
| 48 | == 📋 Source-specific Bronze Lakehouses == | ||
| 49 | |||
| 50 | The Bronze layer is split into individual Lakehouses per source system: | ||
| 51 | |||
| 52 | * 💻 [[BMD Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.BMD-Bronze-Lakehouse.WebHome]] — data from BMD | ||
| 53 | * 🗄️ [[Rimo Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Rimo-Lakehouse.WebHome]] — data from Rimo DWH | ||
| 54 | * 🔧 [[Board Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Board-Bronze-Lakehouse.WebHome]] — data from Board (via Gen2 Dataflow) | ||
| 55 | * 🏗️ [[H3A Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.H3A-Bronze-Lakehouse.WebHome]] — data from H3A | ||
| 56 | * 📁 [[SharePoint Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.SharePoint-Bronze-Lakehouse.WebHome]] — data from SharePoint files | ||
| 57 | |||
| 58 | ---- | ||
| 59 | |||
| 60 | {{info}} | ||
| 61 | **Migration note:** This page was migrated on 24.05.2026 from SharePoint WikiPowerBI into the Lumi-XWiki staging. | ||
| 62 | |||
| 63 | **Original author:** Bukkerji Sreejith (created 2025-10-07, last modified 2025-10-09) | ||
| 64 | **Original source:** [[Lakehouse (SharePoint)>>url:https://spltele.sharepoint.com/sites/WikiPowerBI/SitePages/Lakehouse.aspx]] | ||
| 65 | **Migration:** Dimitri Rupp via ClaudeAI | ||
| 66 | |||
| 67 | **Migration remarks:** | ||
| 68 | * Original language (English) preserved | ||
| 69 | * SharePoint 3-card Editorial layout (Storage / Transformation / Access) converted to three H2 sections with bullet structure | ||
| 70 | * Stock-image cards (Hubble) omitted — purely decorative | ||
| 71 | * **Mermaid Bronze→Silver→Gold flow** added for the medallion architecture | ||
| 72 | * Cross-links to all Lakehouse sub-pages prepared — those not yet migrated will appear red until later waves | ||
| 73 | {{/info}} | ||
| 74 | |||
| 75 | |||
| 76 | ---- | ||
| 77 | |||
| 78 | == Verwandte Themen == | ||
| 79 | |||
| 80 | {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}} | ||
| 81 | |||
| 82 | ---- | ||
| 83 | **Status:** Migriert — Team-Review ausstehend · **Owner:** //(festlegen)// · **Letzter Review:** 2026-06-11 |