Data Warehouse ETL Framework

EDW Catapult Users Guide Data Warehouse ETL Framework Real Time Analytics Defined Docs Why Do You Need An ETL Framework?Data as a Competitive Necessity The Benefits Of Using Python And SQL

Introduction To The ETL Framework
Framework Overview
General Principles
DataOps For The Uninitiated
ETL Developer's Field Guide
ETL Environment Set Up
Standard SSIS ETL Development Package
Sample Script Guide
A Methodology To Rapidly Convert OLTP Databases to OLAP Solutions
Data Model Creation Tool
Performance Monitoring
Data Warehouse Troubleshooting Guide
- Generalized Troubleshooting Steps
Business Analytics Capability Maturity Model
Appendices
- Appendix A. What is Medium Data®?
- Appendix B. The Benefits Of Using Python And T-SQL Over SSIS For ETL

Powered by GitBook

On this page

PySpark

PreviousPassive Monitoring System Design Theory NextConnectToSpark

Last updated 3 years ago

In the case where you have to work on big data, I have included some ideas about how to process it. This is not formally part of the framework and is not totally integrated in any formal way. This is just some thoughts and examples of things that you might find challenging.

The documentation for PySpark can be found at

PySpark Documentation — PySpark 3.2.0 documentation