Skip to Content

Wiki source code of SharePoint Bronze Lakehouse

Last modified by Dimitri Rupp on 2026/06/11 09:30
Show last authors
1 {{box cssClass="floatinginfobox" title="**On this page**"}}
2 {{toc/}}
3 {{/box}}
4
5 = SharePoint Bronze Lakehouse =
6
7 {{info}}
8 **Source system:** SharePoint — diverse SPL sites (lists, libraries, Excel files)
9 **Stage:** Bronze (raw landing zone)
10 **Owner:** Fabric team (restricted access)
11 {{/info}}
12
13 == Overview ==
14
15 |=(% style="width:80px" %)📋 **What**|Data from **various SharePoint sites in SPL** — landed in Bronze without transformations.
16 |=(% style="width:80px" %)🔄 **How**|**Notebooks** and **Dataflows** (Python / Gen2).
17 |=(% style="width:80px" %)🔐 **Who**|Access is **restricted to the Fabric team**.
18
19 == About this Lakehouse ==
20
21 (% style="font-family:monospace" %)sharepoint_bronze_lh(%%) is the landing zone for all the data from the SharePoint files in SPL. This Lakehouse is **schema-enabled**, and the tables are stored in **schemas matching the source name** — unlike (% style="font-family:monospace" %)rimo_bronze_lh(%%), which had to fall back to a flat (% style="font-family:monospace" %)dbo(%%) schema because Fabric did not yet support custom schemas at the time of provisioning.
22
23 {{info}}
24 **Note — Telefónica Excel files:** The Telefónica Excel files are included in this Lakehouse as **shortcuts** from the (% style="font-family:monospace" %)northlakepmo2(%%) ADLS account. Since these files are **not stored in Delta format**, they do **not appear** under the **Tables** section of the Lakehouse. To access them, navigate to the **Files** section and browse to the (% style="font-family:monospace" %)telefoncia_staging(%%) folder.
25 {{/info}}
26
27 == Orchestration ==
28
29 |=Property|=Value
30 |🛠️ Tool|**Python Notebooks** (primary), Gen2 Dataflows
31 |ℹ️ Function|Copy data from SharePoint files to Lakehouse
32 |⚡ Trigger|On refresh schedule
33 |🕞 Time|Week days
34
35 {{mermaid}}
36 flowchart LR
37 subgraph SP[SharePoint sources]
38 direction TB
39 S1[SPL SharePoint<br/>Sites & Lists]
40 S2[Excel files]
41 S3[Telefonica Excel<br/>shortcut to ADLS]
42 end
43
44 subgraph ORC[Orchestration]
45 direction TB
46 NB[Python Notebooks]
47 DF[Gen2 Dataflow]
48 end
49
50 S1 --> NB
51 S2 --> NB
52 S2 --> DF
53 NB --> LH[(sharepoint_bronze_lh<br/>schema-enabled<br/>Bronze Lakehouse)]
54 DF --> LH
55
56 S3 -.->|shortcut| FILES[Files / telefoncia_staging<br/>non-Delta]
57 FILES -.->|reference| LH
58
59 LH -->|consumed by| SIL[Silver Lakehouse]
60
61 classDef src fill:#e3f2fd,stroke:#1976d2,stroke-width:1px
62 classDef orc fill:#fff3cd,stroke:#b85c00,stroke-width:1px
63 classDef brz fill:#f4a261,stroke:#b85c00,stroke-width:1px,color:#000
64 classDef sil fill:#c0c0c0,stroke:#555,stroke-width:1px
65 classDef files fill:#e8f5e9,stroke:#2e7d32,stroke-width:1px
66
67 class S1,S2,S3 src
68 class NB,DF orc
69 class LH brz
70 class SIL sil
71 class FILES files
72 {{/mermaid}}
73
74 == Two storage paths in this Lakehouse ==
75
76 |=Path|=Format|=Visible under|=Typical content
77 |**Tables**|Delta|//Tables// section|Notebook-/Dataflow-ingested SharePoint data
78 |**Files**|Excel / non-Delta|//Files// section|Telefónica Excel-Shortcuts in (% style="font-family:monospace" %)telefoncia_staging(%%)
79
80 == List of tables ==
81
82 Die Live-Tabellen-Liste wird in SharePoint ueber einen **eingebetteten Power-BI-Report** angezeigt. Im XWiki-Staging ist dieser Embed nicht reproduzierbar (Authentifizierung gegen den Tenant erforderlich).
83
84 {{warning}}
85 **Hinweis:** Die aktuelle, live aktualisierte Tabellenliste ist im Original-SharePoint-Page-Embed verfuegbar:
86 **Report:** [[Tables in sharepoint_bronze_lh (Power BI)>>url:https://app.powerbi.com/groups/415dc7b4-7397-41ca-8764-98be71d970c1/reports/72ba0e99-aa57-48a2-bcc4-957b6c864651/419351b9c17e7d994028]]
87 Beim Transfer ins Ziel-Wiki: Embed-Mechanismus pruefen (vermutlich (% style="font-family:monospace" %){{powerbi}}(%%)-Macro oder iframe mit App-Token).
88 {{/warning}}
89
90 == Operational notes ==
91
92 * **Schedule:** Refresh laeuft an Wochentagen — anders als die taeglich um 04:xx laufenden BMD / Rimo / H3A / Board Pipelines.
93 * **Schema-aware:** Tabellen liegen in **Quellsystem-benannten Schemas**, nicht in (% style="font-family:monospace" %)dbo(%%).
94 * **Non-Delta-Daten:** Excel-Files (Telefonica) sind ueber **ADLS-Shortcuts** als Files eingebunden, nicht als Tables.
95 * **Access:** Restricted to the Fabric team.
96
97 == Related pages ==
98
99 * [[Bronze Lakehouse (Hub)>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.WebHome]]
100 * [[Fabric Lakehouse Hub>>doc:IT-Wiki.01-Data.Processing.Lakehouse.WebHome]]
101 * [[Microsoft Fabric Datenarchitektur im SPL>>doc:IT-Wiki.01-Data.Microsoft-Fabric-Datenarchitektur-im-SPL.WebHome]]
102 * [[Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]]
103 * [[Gold Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Gold-Lakehouse.WebHome]]
104
105 ----
106
107 == Verwandte Themen ==
108
109 //Kuratiert — kann direkt im Editor ergänzt werden://
110
111 * [[BMD Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.BMD-Bronze-Lakehouse.WebHome]]
112 * [[Board Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.Board-Bronze-Lakehouse.WebHome]]
113 * [[H3A Bronze Lakehouse>>doc:IT-Wiki.01-Data.Ingestion.Bronze-Lakehouse.H3A-Bronze-Lakehouse.WebHome]]
114
115 {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}}
116
117 ----
118 **Status:** Migriert — Team-Review ausstehend · **Owner:** //(festlegen)// · **Letzter Review:** 2026-06-11