Skip to Content

Wiki source code of Lakehouse-Architektur

Version 1.1 by Dimitri Rupp on 2026/06/11 09:16
Show last authors
1 {{box cssClass="floatinginfobox" title="**Contents**"}}
2 {{toc/}}
3 {{/box}}
4
5 = 💧 Fabric Lakehouse =
6
7 {{info}}
8 A **Lakehouse** in Microsoft Fabric is a unified data architecture that merges the scalability of a data lake with the structure and performance of a data warehouse, offering a single platform for storing, managing, and analyzing structured and unstructured data.
9 {{/info}}
10
11 == 🗄️ Storage ==
12
13 Data is stored in **Delta tables**, which support ACID transactions, schema evolution, and time travel. A Lakehouse contains two zones — **Tables** and **Files**.
14
15 * **Tables** — managed Delta tables with full metadata support
16 * **Files** — unmanaged storage for raw data (CSV, Parquet, images, etc.), accessible via Spark but not queryable via SQL endpoint unless converted to Delta
17
18 == 🔄 Transformation ==
19
20 **Dataflows Gen2**, **Notebooks** (PySpark / Spark SQL), and **Pipelines** enable ingestion, cleansing, and transformation. These tools integrate natively with Lakehouses for modular, reproducible workflows.
21
22 == 🔐 Access ==
23
24 Lakehouses expose a **SQL endpoint** for T-SQL queries. Access is governed via **Microsoft Entra ID**, with support for workspace roles, item-level permissions, and Service Principals for secure external automation.
25
26 == 🏗️ Layers in our architecture ==
27
28 The SPL Fabric architecture follows the **medallion pattern** with three layers:
29
30 {{mermaid}}
31 flowchart LR
32 SRC[📂 Source Systems] --> B[🥉 Bronze<br/>Landing zone]
33 B --> S[🥈 Silver<br/>Transformation]
34 S --> G[🥇 Gold<br/>Business-ready]
35 G --> CONS[📊 Consumers<br/>Power BI / Excel / Board]
36
37 style B fill:#cd7f32,color:#fff
38 style S fill:#c0c0c0,color:#000
39 style G fill:#ffd700,color:#000
40 {{/mermaid}}
41
42 * [[Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.WebHome]] — landing zone with raw data from source systems
43 * [[Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]] — transformation zone, cleaned and enriched data
44 * [[Gold Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Gold-Lakehouse.WebHome]] — business-ready datasets for reporting and analytics
45
46 For detailed access instructions, see [[Get data from Lakehouse>>doc:IT-Wiki.02-Tools.Fabric.Get-data-from-Lakehouse.WebHome]].
47
48 == 📋 Source-specific Bronze Lakehouses ==
49
50 The Bronze layer is split into individual Lakehouses per source system:
51
52 * 💻 [[BMD Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.BMD-Bronze-Lakehouse.WebHome]] — data from BMD
53 * 🗄️ [[Rimo Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Rimo-Lakehouse.WebHome]] — data from Rimo DWH
54 * 🔧 [[Board Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Board-Bronze-Lakehouse.WebHome]] — data from Board (via Gen2 Dataflow)
55 * 🏗️ [[H3A Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.H3A-Bronze-Lakehouse.WebHome]] — data from H3A
56 * 📁 [[SharePoint Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.SharePoint-Bronze-Lakehouse.WebHome]] — data from SharePoint files
57
58 ----
59
60 {{info}}
61 **Migration note:** This page was migrated on 24.05.2026 from SharePoint WikiPowerBI into the Lumi-XWiki staging.
62
63 **Original author:** Bukkerji Sreejith (created 2025-10-07, last modified 2025-10-09)
64 **Original source:** [[Lakehouse (SharePoint)>>url:https://spltele.sharepoint.com/sites/WikiPowerBI/SitePages/Lakehouse.aspx]]
65 **Migration:** Dimitri Rupp via ClaudeAI
66
67 **Migration remarks:**
68 * Original language (English) preserved
69 * SharePoint 3-card Editorial layout (Storage / Transformation / Access) converted to three H2 sections with bullet structure
70 * Stock-image cards (Hubble) omitted — purely decorative
71 * **Mermaid Bronze→Silver→Gold flow** added for the medallion architecture
72 * Cross-links to all Lakehouse sub-pages prepared — those not yet migrated will appear red until later waves
73 {{/info}}
74
75
76 ----
77
78 == Verwandte Themen ==
79
80 {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}}
81
82 ----
83 **Status:** Migriert — Team-Review ausstehend · **Owner:** //(festlegen)// · **Letzter Review:** 2026-06-11