Data Warehouse ETL Framework

EDW Catapult Users Guide Data Warehouse ETL Framework Real Time Analytics Defined Docs Why Do You Need An ETL Framework?Data as a Competitive Necessity The Benefits Of Using Python And SQL

Introduction To The ETL Framework
Framework Overview
General Principles
DataOps For The Uninitiated
ETL Developer's Field Guide
ETL Environment Set Up
Standard SSIS ETL Development Package
Sample Script Guide
A Methodology To Rapidly Convert OLTP Databases to OLAP Solutions
Data Model Creation Tool
Performance Monitoring
Data Warehouse Troubleshooting Guide
- Generalized Troubleshooting Steps
Business Analytics Capability Maturity Model
Appendices
- Appendix A. What is Medium Data®?
- Appendix B. The Benefits Of Using Python And T-SQL Over SSIS For ETL

Powered by GitBook

On this page

General Process

PreviousSlowly Changing Dimension Processing NextCreating Empty Records

Last updated 3 years ago

The general process is explained as follows:

Load the common model table from staging.
Merge existing data with incoming data.
1. Insert new records.
2. Update existing records.
Truncate the common model table.
Load the common model table with key fields necessary to populate fact tables.