Skip to Content

Wiki source code of Fabric Gold Lakehouse

Last modified by Dimitri Rupp on 2026/06/11 09:30
Hide last authors
Dimitri Rupp 1.1 1 {{box cssClass="floatinginfobox" title="**On this page**"}}
2 {{toc/}}
3 {{/box}}
4
5 = Fabric Gold Lakehouse =
6
7 {{info}}
8 **Lakehouse:** (% style="font-family:monospace" %)spl_gold_lh(%%)
9 **Stage:** Gold — Final / Trusted Zone
10 **Owner:** Tightly controlled (database roles)
11 {{/info}}
12
13 == Overview ==
14
15 The **Gold layer** represents the **final, trusted zone** in the data pipeline architecture. It hosts **business-ready**, **aggregated**, and **validated** datasets optimised for **reporting**, **analytics**, and **downstream consumption** via **Power BI**, **semantic models**, and **external applications**.
16
17 == Gold Lakehouse summary ==
18
19 |=(% style="width:140px" %)📋 **Data**|**Tables and Views** stored in **schemas**. Data is cleaned, transformed, and ready for reporting, analytics, and consumption.
20 |=(% style="width:140px" %)🔄 **Transformation**|Data is processed and moved using **Python and Spark notebooks**.
21 |=(% style="width:140px" %)🔐 **Access**|**Database roles** enforce access. **No access** for external applications. User groups can read specific tables and views via the **SQL endpoint**.
22
23 == Organisation, access and governance ==
24
25 All data is stored in a **single Lakehouse** — (% style="font-family:monospace" %)spl_gold_lh(%%) — which is organised using **schema separation**, with schema names aligned to **source domains** for **clarity** and **governance**.
26
27 To support organisation-wide sharing and simplify access management, **shortcuts are no longer recommended** in this Lakehouse. Avoiding shortcuts **eliminates the need for additional permissions** on the underlying Lakehouses, reducing complexity and potential access issues.
28
29 Access to (% style="font-family:monospace" %)spl_gold_lh(%%) is **tightly controlled**:
30
31 * Only **designated user groups** — such as **PBI Power Users** — are granted **SQL-endpoint access**.
32 * **Schema-level** and **object-level** permissions are enforced using **database roles**, ensuring fine-grained control over data exposure and operational integrity.
33
34 == Architecture ==
35
36 {{mermaid}}
37 flowchart LR
38 SIL[(spl_silver_lh<br/>Silver — transformed)] -->|Python / Spark notebooks| GOLD[(spl_gold_lh<br/>Gold — trusted)]
39
40 GOLD --> SQLE[SQL endpoint]
41 SQLE -->|database roles| RG1[PBI Power Users]
42 SQLE -->|database roles| RG2[Other designated groups]
43
44 GOLD --> PBI[Power BI<br/>reports and semantic models]
45 GOLD --> EXT[External applications<br/>read-only via SQL endpoint]
46
47 classDef sil fill:#c0c0c0,stroke:#555,stroke-width:1px,color:#000
48 classDef gold fill:#ffd54f,stroke:#b45f06,stroke-width:1px,color:#000
49 classDef sec fill:#ffe0b2,stroke:#b45f06,stroke-width:1px,color:#000
50 classDef cons fill:#e3f2fd,stroke:#1976d2,stroke-width:1px
51
52 class SIL sil
53 class GOLD,SQLE gold
54 class RG1,RG2 sec
55 class PBI,EXT cons
56 {{/mermaid}}
57
58 == Comparison Bronze / Silver / Gold ==
59
60 |=|=Bronze|=Silver|=Gold
61 |**Purpose**|Raw landing zone|Transformation zone|Trusted, business-ready
62 |**Lakehouses**|5x (BMD, Rimo, Board, SharePoint, H3A)|1x (% style="font-family:monospace" %)spl_silver_lh(%%)|1x (% style="font-family:monospace" %)spl_gold_lh(%%)
63 |**Shortcuts allowed**|n/a — sources|Yes — referencing Bronze|**No** — sharing/governance reason
64 |**Transformations**|None|Cleansing, joining, enrichment|Aggregations, business-ready datasets
65 |**Consumers**|Fabric team|Fabric team / pipelines|Power BI, semantic models, external apps (read-only)
66 |**Access control**|Restricted to Fabric team|Workspace members|Database roles (group-based)
67
68 == Schemas and objects in (% style="font-family:monospace" %)spl_gold_lh(%%) ==
69
70 {{info}}
71 **Note:** The table catalog is a **fully functional embedded Power BI report**. Please wait for a few seconds for the report to load. If a permission error is observed, please contact the Power BI admins.
72 {{/info}}
73
74 {{warning}}
75 **Live-Embed:** Im XWiki-Staging ist der Power-BI-Embed nicht direkt einbettbar (Authentifizierung gegen den SPL-Tenant erforderlich). Die Quelle ist als externer Link unten verlinkt; beim Transfer ins Ziel-Wiki (SPL-Tele intern) ist der (% style="font-family:monospace" %){{powerbi}}(%%)-Macro oder ein App-Token-gestuetzter iframe zu verwenden.
76
77 **Report:** [[Tables/objects in spl_gold_lh (Power BI)>>url:https://app.powerbi.com/groups/415dc7b4-7397-41ca-8764-98be71d970c1/reports/72ba0e99-aa57-48a2-bcc4-957b6c864651/899f12d3d5b95e5404ae]]
78 {{/warning}}
79
80 == Views in (% style="font-family:monospace" %)spl_gold_lh(%%) ==
81
82 Shows the **view definition** and **dependencies**.
83
84 {{info}}
85 **Note:** Der Katalog ist ebenfalls ein **eingebetteter Power-BI-Report**. Bitte einen Moment auf den Ladevorgang warten. Bei einem Permission-Error: Power-BI-Admins kontaktieren.
86 {{/info}}
87
88 **Report:** [[Views in spl_gold_lh (Power BI)>>url:https://app.powerbi.com/groups/415dc7b4-7397-41ca-8764-98be71d970c1/reports/72ba0e99-aa57-48a2-bcc4-957b6c864651/ec76219fa1e1dae0bdd1]]
89
90 == Operational notes ==
91
92 * **No shortcuts:** Gold vermeidet bewusst Shortcuts. Tabellen werden persistent geschrieben, um Sharing und Governance zu vereinfachen.
93 * **SQL endpoint als zentraler Zugang:** Externe Anwendungen und Power Users lesen ueber den SQL endpoint, nicht ueber die Lakehouse-API.
94 * **Database roles:** Berechtigungen werden auf Schema- und Objekt-Ebene per Rolle vergeben — nicht pro User.
95 * **Semantic models:** Power BI semantic models konsumieren aus Gold und stellen die letzte Modellierungs-Schicht fuer Reports dar.
96
97 == Related pages ==
98
99 * [[Bronze Lakehouse (Hub)>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.WebHome]]
100 * [[Fabric Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]]
101 * [[Fabric Lakehouse Hub>>doc:IT-Wiki.01-Data.Processing.Lakehouse.WebHome]]
102 * [[Microsoft Fabric Datenarchitektur im SPL>>doc:IT-Wiki.01-Data.Microsoft-Fabric-Datenarchitektur-im-SPL.WebHome]]
103
104 ----
105
106 == Verwandte Themen ==
107
108 //Kuratiert — kann direkt im Editor ergänzt werden://
109
110 * [[Fabric Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]]
111
112 {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}}
113
114 ----
115 **Status:** Migriert — Team-Review ausstehend · **Owner:** //(festlegen)// · **Letzter Review:** 2026-06-11
116