Fabric Silver Lakehouse

Version 2.1 by Dimitri Rupp on 2026/06/11 09:16
Warning
For security reasons, the document is displayed in restricted mode as it is not the current version. There may be differences and errors due to this.

Fabric Silver Lakehouse

Information

Lakehouse: spl_silver_lh
Stage: Silver β€” Transformation Zone
Owner: Workspace members (restricted access)

Overview

The Silver layer in our architecture functions as the transformation zone within the data pipeline. Data ingested into the staging layer (Bronze) is cleaned, enriched, and reshaped in the Silver layer to prepare it for analytical consumption β€” or final transformation in the Gold layer.

The Lakehouse designated for this layer β€” spl_silver_lh β€” serves as the central repository for all transformation logic and outputs. This Lakehouse is organised using schema separation, with schema names aligned to the source system or data domain. This structure supports modular development and simplifies governance across heterogeneous data sources.

Within spl_silver_lh, two distinct categories of tables are maintained:

  • Shortcut tables β€” direct references to Bronze-layer tables, created when source data is needed for intermediate transformations without duplication.
  • Transformed tables β€” data that has undergone one or more processing steps (filtering, joining, normalisation, enrichment), making them suitable for downstream consumption in the Gold layer.

Silver Lakehouse summary

πŸ“‹ DataContains shortcuts from Bronze Lakehouses and transformed tables created from them.
πŸ”„ TransformationData is processed using Notebooks and Dataflows.
πŸ” AccessCan be accessed only by Workspace Members.

Architecture

flowchart LR
    subgraph BRZ["**Bronze**"]
        direction TB
        B1[(bmd_bronze_lh)]
        B2[(rimo_bronze_lh)]
        B3[(h3a_bronze_lh)]
        B4[(board_bronze_lh)]
        B5[(sharepoint_bronze_lh)]
    end

    subgraph TRANS["**Silver β€” Transformation**"]
        direction TB
        SC[Shortcut tables
no duplication] TR[Transformed tables
cleansed / joined
enriched] end subgraph SCH["**Silver schemas**"] direction TB SBMD[bmd] SRIMO[rimo] SH3A[h3a] SHU[huawei] SHUTCH[hutch] STEF[telefonica] end BRZ --> SC SC --> TR TR --> SCH SCH -->|consumed by| GOLD[Gold Lakehouse
spl_gold_lh] classDef brz fill:#f4a261,stroke:#b85c00,stroke-width:1px,color:#000 classDef sil fill:#c0c0c0,stroke:#555,stroke-width:1px,color:#000 classDef sch fill:#e3f2fd,stroke:#1976d2,stroke-width:1px classDef gold fill:#ffd54f,stroke:#b45f06,stroke-width:1px,color:#000 class B1,B2,B3,B4,B5 brz class SC,TR sil class SBMD,SRIMO,SH3A,SHU,SHUTCH,STEF sch class GOLD gold

Schemas in spl_silver_lh

  • dbo β€” Fabric-Default (kaum genutzt; Silver-spezifische Domaenen liegen in eigenen Schemas)
  • bmd β€” BMD Finanz/Anlagen
  • h3a β€” H3A Logistik
  • huawei β€” Huawei FusionSolar
  • hutch β€” Hutchison Bau-Forecasts
  • rimo β€” Rimo DWH inkl. Gold-Deletion-Logs
  • telefonica β€” Telefonica SharePoint-Files

Notebooks in use

Data movement and transformation in spl_silver_lh is carried out using notebooks. The following notebooks are currently in use:

NotebookPrimary scope
70203022_H3A_5G_RolloutHutch 5G Rollout (baubeginn / forecast)
huawei_fusionsun_detailedInverterReportHuawei FusionSolar Inverter-Reports
StoredProcedure_weeklyWΓΆchentliche Stored Procedures (Inventory Valuation)
StoredProcedures_BMDBMD-Transformationen
StoredProcedures_BMD_Hinzufuegen_FirmenBMD Firmen-Anreicherung (dim_firmenid)
StoredProcedures_h3aH3A-Transformationen
StoredProcedures_RimoRimo-Transformationen (incl. deletedRows-Logging)
get_tef_DeliveryOffice_files_PolarsTelefonica Delivery Office files (Polars-based)
get_tef_SharePointFilesTelefonica SharePoint files

Table-type overview

TypeCountMeaning
shortcut25Direct shortcut to a Bronze-Lakehouse table β€” kein Duplikat
transformed67Datenverarbeitete Tabelle β€” Filter, Join, Normalisierung, Anreicherung
historized5Historisierte Tabelle (Snapshot ueber Zeit)
deleted-log16Logging fuer aus Gold geloeschte Zeilen (deletedRows_*)
custom3Custom-Tabelle (z.B. custom_sdmperson)
helper1Helper-Tabellen fuer Notebooks
staging3Staging-Tabellen (stage_*)
dimension1Dimensions-Tabellen (dim_*)
mapping0Mapping-Tabellen
fact0Fakten-Tabellen

Live-Liste der Tabellen

The list of tables below is the snapshot at migration time (2026-05-24). To always see the current live state, the source page provided two SQL snippets that can be run against the spl_silver_lh SQL endpoint:

-- Run on spl_silver_lh SQL endpoint to get the live table list
SELECT
   TABLE_NAME    AS [Table],
    TABLE_SCHEMA  AS [Schema]
FROM INFORMATION_SCHEMA.TABLES
WHERE TABLE_TYPE = 'BASE TABLE'
ORDER BY TABLE_SCHEMA, TABLE_NAME;
Warning

Hinweis: Die Original-SharePoint-Page enthielt zwei Code-Snippet-Webparts ohne befuellten Code-Body (leere Snippet-Container). Das obige Beispiel zeigt das Standard-Pattern β€” der konkrete im SPL-Tele eingesetzte Snippet ist beim Migrieren in das produktive XWiki nachzutragen, sobald der Original-Inhalt verfuegbar ist.

Tables in spl_silver_lh β€” by schema

πŸ—‚οΈ Schema: bmd

BMD ERP β€” Finanzbuchhaltung, Anlagen, Kostenrechnung. Mix aus Bronze-Shortcuts und Silver-Transformationen (anbu_*, fibu_*, stage_*).

Tabellen-Anzahl: 18

TableCreatedTypeDescriptionExecutor
anbu_anlagen03-12-2024transformedβ€”StoredProcedures_BMD
anbu_kpi03-12-2024transformedβ€”StoredProcedures_BMD
anbu_lastvalue03-12-2024transformedβ€”StoredProcedures_BMD
anbu_map_anlagen_projekt03-12-2024transformedβ€”StoredProcedures_BMD
dim_firmenid25-11-2024dimensionβ€”StoredProcedures_BMD_HinzufΓΌgen_Firmen
fibu_konto25-11-2024transformedβ€”StoredProcedures_BMD
fibu_map_electrify03-12-2024transformedβ€”StoredProcedures_BMD
import_bmb_bil_acz_anlagegutsackontozu04-08-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_bil_act_anlagegutberech_tmp04-08-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_bil_agu_anlagegut04-08-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_bil_ajo_anbujournal04-08-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_bil_anz_anlagegutkostzu04-08-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_fibu_buchungen08-05-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_fibu_konto08-05-2025shortcutshortcut table from bmd_bronze_lhβ€”
import_bmd_kore_korestamm08-05-2025shortcutshortcut table from bmd_bronze_lhβ€”
stage_fibu_buchungen03-12-2024stagingβ€”StoredProcedures_BMD
stage_fibu_letzte_zahlung25-11-2024stagingβ€”StoredProcedures_BMD
stage_fibu_offenposten25-11-2024stagingβ€”StoredProcedures_BMD

πŸ—‚οΈ Schema: h3a

H3A β€” Logistik (Scan-Items, Historisierung).

Tabellen-Anzahl: 2

TableCreatedTypeDescriptionExecutor
public_sdmlogisticscanitem08-05-2025shortcutshortcut table from h3a_bronze_lhβ€”
sdmlogisticscanitem_historic05-12-2024historizedHistorized tableStoredProcedures_h3a

πŸ—‚οΈ Schema: huawei

Huawei β€” FusionSolar Inverter-Reporting (huawei_fusionsun_*-Notebook).

Tabellen-Anzahl: 4

TableCreatedTypeDescriptionExecutor
fs_detailed_inverter_report06-12-2024historizedHistorized tablehuawei_fusionsun_detailedInverterReport
fs_historizationhelper06-12-2024helperHelperhuawei_fusionsun_detailedInverterReport
fusionsun_detail_wechselrichterbericht06-12-2024shortcutshortcut table from sharepointfiles_bronze_lhβ€”
storagelocations22-11-2024customCustom table createdβ€”

πŸ—‚οΈ Schema: hutch

Hutchison (Hutch) β€” Baubeginn-/Forecast-Daten, eingespielt aus SharePoint-Files.

Tabellen-Anzahl: 3

TableCreatedTypeDescriptionExecutor
baubeginn_fc_historized04-04-2025historizedHistorized table70203022_H3A_5G_Rollout
current_baubeginn_fc23-04-2025shortcutshortcut table from sharepointfiles_bronze_lhβ€”
forecast17-06-2025shortcutshortcut table from sharepointfiles_bronze_lhβ€”

πŸ—‚οΈ Schema: rimo

Rimo β€” DWH-Tabellen (Bronze-Shortcuts), Custom-Tabellen, deletedRows_*-Logs aus Gold, Historisierungen.

Tabellen-Anzahl: 35

TableCreatedTypeDescriptionExecutor
custom_sdmperson10-01-2025customCustom table with only externalid and full person nameStoredProcedures_Rimo
custom_sdmproductticket26-03-2025customCustom table with data type fixed. Not sure about purposeβ€”
deletedRows_sdmactivity25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmbsscartitem25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmbssmaterialaccountingorder25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmbssoutboundstockorder25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmbssprojectcontrollingitem02-10-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmbssworkpackage25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmbsswpmilestone25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmincident25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdminvoiceassignment25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmmaterial25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmmaterialchangeorder25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmofferitemservice25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmproductivizationentry25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmsalesorder25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_sdmsubticket25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
deletedRows_splworkentry25-09-2025deleted-logDeleted rows from the table in spl_gold_lh (for logging)StoredProcedures_Rimo
inventory_valuation_historic03-01-2025historizedHistorized tableStoredProcedure_weekly
inventory_valuation_historic_tmp28-12-2024transformedβ€”β€”
otbstoragedepot21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
otbstoragespace21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
salesorder_hierarchy17-09-2025transformedTable created by joining sdmsalesorder, sdmwtrprojectgroup tablesStoredProcedures_Rimo
sdmdebitor21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmlogisticscanitem19-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmlogisticscanitem_historic26-11-2024shortcutshortcut table from rimo_bronze_lhβ€”
sdmmanufacturer21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmmasteritem21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmmaterial21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmperson02-10-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmproductticket19-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmsalesorder19-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
sdmwtrprojectgroup21-09-2025shortcutshortcut table from rimo_bronze_lhβ€”
toolaccounting19-09-2025historizedHistorized version of toolaccounting_deltaStoredProcedures_Rimo
toolaccounting_delta08-05-2025shortcutshortcut table from rimo_bronze_lhβ€”

πŸ—‚οΈ Schema: telefonica

Telefonica β€” SharePoint-Files-Ingestion via get_tef_*-Notebooks (Polars). Operational Tracking, FNEP, RAN, Forecast.

Tabellen-Anzahl: 59

TableCreatedTypeDescriptionExecutor
abnahme_tracking_rueckbau04-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
acceptance_arbeitsreport_aktuell_fnep19-05-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
acceptance_arbeitsreport_aktuell_ran19-05-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
acceptance_mw_aktuell23-05-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
acceptance_ran_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
batteriewuerdigkeit_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
carrier_aktuell17-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
carrier_aktuell_33019-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
carrier_aktuell_verzoegrung19-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
deinstallations_tracking10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
festnetzerweiterung_aktuell01-07-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
fileversioninfo25-04-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles / get_tef_DeliveryOffice_files_Polars
greenfield_aktuell08-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
gu8_projekte_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
gu_spl18-09-2025transformedTable from Telefonica excel reportsget_tef_DeliveryOffice_files_Polars
hwl_hardwarebuildproposal_gu10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
installations_tracking10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
instdeinstmeldungen_dim10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
instdeinstmeldungen_im10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
ipclock_aktuell11-04-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
leasedline_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
linkketten_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
materialsox_tracking_gu10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
microwave_aktuell29-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
microwave_south_aktuell29-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
multiprojekt_uni_ordering10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
multiprojekt_uni_transport10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
multiprojekt_uni_transport_inaktiv10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
multiprojekte_ugg_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
multiprojekte_ugg_ordering_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
ne73_multiprojekt_aktuell01-07-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
nlg_cube_aktuell29-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
nrg_aktuell29-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_jsl_multiprojekt_aktuell02-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_jsl_multiprojekt_inaktiv_aktuell02-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_multiprojekt_aktuell19-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_mxs_aktiv02-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_mxs_ordering_mp05-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_mxs_standortauftrag05-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_standortauftrage_aktuell15-07-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
poc_vpn2_multiprojekt_aktuell28-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
router_aktuell15-07-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
router_swap_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
sp_rueckbau05-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
sp_rueckbau_link05-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
sp_rueckbau_ne05-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
standorte_aktuell18-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
standortprojekte_gesamt_aktuell28-07-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
tdmswapout_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
tom_wos_data_spl25-04-2025transformedTable from Telefonica excel reportsget_tef_DeliveryOffice_files_Polars
tom_wos_wd_op_op_item02-06-2025transformedTable from Telefonica excel reportsget_tef_DeliveryOffice_files_Polars
uts_integration_rejection_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
uts_releases_aktuell05-09-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
wertberichtigungsmeldung_apt03-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
wertberichtigungsmeldung_dim03-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
wertberichtigungsmeldung_positionen03-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
xwdm_aktuell08-08-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
xwdm_multiprojekt_aktuell25-03-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles
zugangsdaten_aktuell10-02-2025transformedTable from Telefonica excel reportsget_tef_SharePointFiles

Operational notes

  • Schema-aware: Domains sind in eigenen Schemas. Cross-Schema-Joins sind moeglich, aber Governance-relevant.
  • Shortcuts vs. Transformed: Shortcuts sparen Speicher und halten Datenstand 1:1 mit Bronze. Transformed-Tabellen sind das "echte" Silver-Asset.
  • DeletedRows_*-Pattern: Aus dem Gold-Lakehouse geloeschte Zeilen werden zur Audit-Sicherheit in Silver geloggt (Rimo-Schema).
  • Access: Restricted to Workspace Members.

Related pages


Information

Migration footer
Source: Fabric Silver Lakehouse (SharePoint)
Original author: Bukkerji Sreejith β€” Sreejith.Bukkerji@spl-tele.com
Original last-modified: 2025-10-13
Migration date: 2026-05-24
Migrated by: Dimitri Rupp via ClaudeAI
Notes: EN-Original-Intro 1:1; 3-card-Layout zu Summary-Tabelle umgesetzt; Mermaid Bronze→Silver→Gold-Diagramm ergaenzt; Notebooks-Liste extrahiert; Tabellen-Typ-Heuristik (shortcut/transformed/historized/deleted-log/custom/helper) eingefuehrt fuer Orientierung; 121 Tabellen aus 6 Schemas (bmd/h3a/huawei/hutch/rimo/telefonica) gruppiert; leere Code-Snippets der Quelle mit Standard-INFORMATION_SCHEMA-Pattern dokumentiert und Warning-Box ergaenzt.


Verwandte Themen

Kuratiert β€” kann direkt im Editor ergΓ€nzt werden://

Failed to execute the [velocity] macro. Cause: [The execution of the [velocity] script macro is not allowed in [xwiki:IT-Wiki.Makros.Verwandte-Themen.WebHome]. Check the rights of its last author or the parameters if it's rendered from another script.]. Click on this message for details.


Status: Migriert β€” Team-Review ausstehend Β· Owner: (festlegen) Β· Letzter Review: 2026-06-11