Customize And Run Deployment Scripts

Deploying the framework is as simple as running F5 on a bunch of scripts. However, you'll need to customize some scripts so they will work with your specific system.

The scripts can be found in etl-framework\Framework Deployment Scripts organized by function and named in order of their execution.

Once the scripts have been customized, you can run them with the exception of InstallFrameworkPackages.py. That file needs some prep work before it can run properly. See Install Python Packages.

01 Create Initial Databases

Script Name	Customization Instructions
01 CREATE DATABASE EDW	Replace: [Your Data Warehouse Database Name] With: The name of your EDW.
02 CREATE DATABASE ODS	None.
03 CREATE DATABASE Reporting	None.
04 CREATE DATABASE SSISManagement	None.
05 CREATE INITIAL SCHEMAS	Replace: [Your Data Warehouse Database Name] With: The name of your EDW.

02 Date Dimension

Script Name	Customization Instructions
01 CREATE AND POPULATE DimMonth AND DimDate	Detailed instructions in script.
02 add empty and error rows	Replace [YourDatabaseName] with the specific name of your EDW and run.
03 ALTER TABLE DimDate ADD FiscalColumns	Detailed instructions in script.

03 Framework Objects

Script Name	Customization Instructions
01 Create ETL Framework Tables	None.
02 CREATE TABLE TableLoadReport	None.
03 Create ETL Framework Stored Procs	None.
04 CREATE PROC usp_ErrorLogByPackage	None.
05 CREATE PROC usp_BatchRunTime	None.
06 CREATE PROC usp_ErrorLogByBatch	None.
07 CREATE PROC usp_GetVariableValues	None.
08 CREATE PROC PackageRunTime	None.
09 CREATE TABLE SSISConfigurations	None.
10 CREATE VIEW RowCountLog	None.
11 CREATE VIEW ShowAdverseTableLoads	None.
12 CREATE VIEW SSISErrorLogByPackage	None.
13 CREATE VIEW SSISPackageBatchRunTime	None.
14 CREATE VIEW SSISPackageRunTime	None.
15 CREATE FUNCTION udf_CleanDate	None.
16 CREATE TABLE LoadObservations	None.
17 CREATE TABLE Tables	None.

04 Python Package Installation

This script

Script Name	Customization Instructions
InstallFrameworkPackages	None