Wiki source code of Lakehouse-Architektur

Last modified by Dimitri Rupp on 2026/06/11 09:30

Show last authors
1 {{box cssClass="floatinginfobox" title="**Contents**"}}
2 {{toc/}}
3 {{/box}}
4
5 = ๐Ÿ’ง Fabric Lakehouse =
6
7 {{info}}
8 A **Lakehouse** in Microsoft Fabric is a unified data architecture that merges the scalability of a data lake with the structure and performance of a data warehouse, offering a single platform for storing, managing, and analyzing structured and unstructured data.
9 {{/info}}
10
11 == ๐Ÿ—„๏ธ Storage ==
12
13 Data is stored in **Delta tables**, which support ACID transactions, schema evolution, and time travel. A Lakehouse contains two zones โ€” **Tables** and **Files**.
14
15 * **Tables** โ€” managed Delta tables with full metadata support
16 * **Files** โ€” unmanaged storage for raw data (CSV, Parquet, images, etc.), accessible via Spark but not queryable via SQL endpoint unless converted to Delta
17
18 == ๐Ÿ”„ Transformation ==
19
20 **Dataflows Gen2**, **Notebooks** (PySpark / Spark SQL), and **Pipelines** enable ingestion, cleansing, and transformation. These tools integrate natively with Lakehouses for modular, reproducible workflows.
21
22 == ๐Ÿ” Access ==
23
24 Lakehouses expose a **SQL endpoint** for T-SQL queries. Access is governed via **Microsoft Entra ID**, with support for workspace roles, item-level permissions, and Service Principals for secure external automation.
25
26 == ๐Ÿ—๏ธ Layers in our architecture ==
27
28 The SPL Fabric architecture follows the **medallion pattern** with three layers:
29
30 {{mermaid}}
31 flowchart LR
32 SRC[๐Ÿ“‚ Source Systems] --> B[๐Ÿฅ‰ Bronze<br/>Landing zone]
33 B --> S[๐Ÿฅˆ Silver<br/>Transformation]
34 S --> G[๐Ÿฅ‡ Gold<br/>Business-ready]
35 G --> CONS[๐Ÿ“Š Consumers<br/>Power BI / Excel / Board]
36
37 style B fill:#cd7f32,color:#fff
38 style S fill:#c0c0c0,color:#000
39 style G fill:#ffd700,color:#000
40 {{/mermaid}}
41
42 * [[Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.WebHome]] โ€” landing zone with raw data from source systems
43 * [[Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]] โ€” transformation zone, cleaned and enriched data
44 * [[Gold Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Gold-Lakehouse.WebHome]] โ€” business-ready datasets for reporting and analytics
45
46 For detailed access instructions, see [[Get data from Lakehouse>>doc:IT-Wiki.02-Tools.Fabric.Get-data-from-Lakehouse.WebHome]].
47
48 == ๐Ÿ“‹ Source-specific Bronze Lakehouses ==
49
50 The Bronze layer is split into individual Lakehouses per source system:
51
52 * ๐Ÿ’ป [[BMD Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.BMD-Bronze-Lakehouse.WebHome]] โ€” data from BMD
53 * ๐Ÿ—„๏ธ [[Rimo Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Rimo-Lakehouse.WebHome]] โ€” data from Rimo DWH
54 * ๐Ÿ”ง [[Board Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Board-Bronze-Lakehouse.WebHome]] โ€” data from Board (via Gen2 Dataflow)
55 * ๐Ÿ—๏ธ [[H3A Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.H3A-Bronze-Lakehouse.WebHome]] โ€” data from H3A
56 * ๐Ÿ“ [[SharePoint Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.SharePoint-Bronze-Lakehouse.WebHome]] โ€” data from SharePoint files
57
58 ----
59
60 == Verwandte Themen ==
61
62 {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}}
63
64 ----
65 **Status:** Migriert โ€” Team-Review ausstehend ยท **Owner:** //(festlegen)// ยท **Letzter Review:** 2026-06-11