This program intergrates data sources into target systems then verifies data quality by conducting a range of quality checks on staged data in the billing-datawarehouse by looking for missing values and dublicated records.The program achieves the objective of decoupling processing from source systems, helpnig to miniimize data corruption and acting as an archive at the same time.
-
Design and implement billing-datawarehouse schema.
-
Load Customer and Month dimension tables.
-
Load data into the FactBilling fact table.
-
Verify loaded data.
-
Perform data quality checks
5.1 Check Null values
5.2 Check Duplicate values
5.3 Check Min Max
5.4 Check Invalid values
-
Generate a report on data quality.