Wiki source code of List of notebooks in use
Last modified by Dimitri Rupp on 2026/06/11 09:30
Hide last authors
| author | version | line-number | content |
|---|---|---|---|
 |
1.1 | 1 | {{box cssClass="floatinginfobox" title="**On this page**"}} |
| 2 | {{toc/}} | ||
| 3 | {{/box}} | ||
| 4 | |||
| 5 | = List of notebooks in use = | ||
| 6 | |||
| 7 | {{info}} | ||
| 8 | **Scope:** Vergleich Spark- vs. Vanilla-Notebook + Language-Support-Matrix fuer Microsoft Fabric. | ||
| 9 | **Parent:** [[Fabric Notebooks>>doc:IT-Wiki.02-Tools.Fabric.Fabric-Notebooks.WebHome]] | ||
| 10 | {{/info}} | ||
| 11 | |||
| 12 | == To "Spark" or not to? == | ||
| 13 | |||
| 14 | Fabric notebooks offer a **flexible canvas** for data exploration and transformation, empowering users to choose the language that best suits their **skill set** and **workload**. Whether you're fluent in **Python**, **Scala**, **R**, or **SQL**, Fabric accommodates your preferences with ease. | ||
| 15 | |||
| 16 | However, when it comes to choosing between **Spark notebooks** and **Vanilla notebooks**, the decision often hinges on **performance**, **scalability**, and **distributed processing needs**. | ||
| 17 | |||
| 18 | == Language support == | ||
| 19 | |||
| 20 | |=Language|=Spark support|=Vanilla support | ||
| 21 | |**Python**|✅ Yes|✅ Yes (Standard Python Kernel) | ||
| 22 | |**SQL**|✅ Yes|✅ Yes (T-SQL) | ||
| 23 | |**Scala**|✅ Yes|❌ No | ||
| 24 | |**R**|✅ Yes|❌ No | ||
| 25 | |||
| 26 | == Spark vs. Vanilla notebooks — feature comparison == | ||
| 27 | |||
| 28 | |=Feature|=Spark notebook|=Vanilla notebook | ||
| 29 | |**Execution engine**|Distributed (Apache Spark)|Local (single node) | ||
| 30 | |**Performance**|Scales for large datasets|Best for light-weight tasks | ||
| 31 | |**Session management**|Cluster-backed, has start-up latency|Immediate execution | ||
| 32 | |**Libraries**|Spark-compatible libraries|Full access to Python ecosystem | ||
| 33 | |**Custom environments**|Yes|No | ||
| 34 | |**Memory limit**|Scalable across nodes|16 GB hard limit | ||
| 35 | |**Startup time**|~10 to 30 seconds|Instant | ||
| 36 | |||
| 37 | == Decision heuristic == | ||
| 38 | |||
| 39 | {{mermaid}} | ||
| 40 | flowchart TD | ||
| 41 | Q[Workload?] --> S{Dataset size?} | ||
| 42 | S -->|"Small / medium (< 16 GB)"| VAN[Vanilla notebook<br/>instant + cheap] | ||
| 43 | S -->|"Large / distributed"| SPK[Spark notebook<br/>distributed] | ||
| 44 | VAN --> L1{Need Scala / R?} | ||
| 45 | L1 -->|Yes| SPK | ||
| 46 | L1 -->|No| VAN | ||
| 47 | |||
| 48 | classDef van fill:#c8e6c9,stroke:#2e7d32,stroke-width:1px | ||
| 49 | classDef spk fill:#bbdefb,stroke:#1976d2,stroke-width:1px | ||
| 50 | class VAN van | ||
| 51 | class SPK spk | ||
| 52 | {{/mermaid}} | ||
| 53 | |||
| 54 | {{info}} | ||
| 55 | **Note:** Notebooks that are **currently not in service** and those in the **Fabric_Dev workspace** are not mentioned in the above documentation. **Not-in-service** notebooks can be found in the (% style="font-family:monospace" %)08_archive(%%) folder of the Fabric workspace. | ||
| 56 | {{/info}} | ||
| 57 | |||
| 58 | == Notebooks aktuell im Einsatz == | ||
| 59 | |||
| 60 | Die operative Liste der **aktiv genutzten Notebooks** mit Funktion und Schema ist in der [[Fabric Silver Lakehouse>>doc:IT-Wiki.01-Data.Processing.Lakehouse.Fabric-Silver-Lakehouse.WebHome]]-Dokumentation dokumentiert (Abschnitt "Notebooks in use") — dort werden 9 Notebooks beschrieben: | ||
| 61 | |||
| 62 | * (% style="font-family:monospace" %)70203022_H3A_5G_Rollout(%%) | ||
| 63 | * (% style="font-family:monospace" %)huawei_fusionsun_detailedInverterReport(%%) | ||
| 64 | * (% style="font-family:monospace" %)StoredProcedure_weekly(%%) | ||
| 65 | * (% style="font-family:monospace" %)StoredProcedures_BMD(%%) | ||
| 66 | * (% style="font-family:monospace" %)StoredProcedures_BMD_Hinzufuegen_Firmen(%%) | ||
| 67 | * (% style="font-family:monospace" %)StoredProcedures_h3a(%%) | ||
| 68 | * (% style="font-family:monospace" %)StoredProcedures_Rimo(%%) | ||
| 69 | * (% style="font-family:monospace" %)get_tef_DeliveryOffice_files_Polars(%%) | ||
| 70 | * (% style="font-family:monospace" %)get_tef_SharePointFiles(%%) | ||
| 71 | |||
| 72 | ---- | ||
| 73 | |||
| 74 | == Verwandte Themen == | ||
| 75 | |||
| 76 | {{include reference="IT-Wiki.Makros.Verwandte-Themen.WebHome"/}} | ||
| 77 | |||
| 78 | ---- | ||
| 79 | **Status:** Migriert — Team-Review ausstehend · **Owner:** //(festlegen)// · **Letzter Review:** 2026-06-11 | ||
| 80 |