The following documents require to start writing Test case.
1) Unit Testing
2) Development Integration Testing
3) System Integration Testing
4) User Acceptance Testing
1) Verify data loss
2) No.of records in the source and target
3) Dataload/Insert
4) Dataload/Update
5) Incremental load
6) Data accuracy
7) verify Naming standards.
8) Verify column Mapping
- BRD(Business Requirement Documentation) : In this documents it contains brief description about the project and first level to end staging.
- Functional Document : It contains functional testing how to check the functionality of mapping.
- Mapping Document: Mapping document specifies what are the sources systems what are the target systems .
- HLD(High Level Design Document) : An ETL Architect and DWH Architect participate in designing a solution to build a DWH.
An HLD document is prepared based on Business Requirement. - LLD(Low Level Design Document): Based on HLD,a senior ETL developer prepare Low Level Design Document
The LLD contains more technical details of an ETL System.
An LLD contains data flow diagram ( DFD ), details of source and targets of each mapping.
An LLD also contains information about full and incremental load.
After LLD then Development Phase will start.
The following various types testing carried out in testing environment.
1) Unit Testing
2) Development Integration Testing
3) System Integration Testing
4) User Acceptance Testing
Unit Testing :-
- -> A unit test for the DWH is a white Box testing,It should check the ETL procedure and Mappings.
- -> The following are the test cases can be executed by an ETL developer.
1) Verify data loss
2) No.of records in the source and target
3) Dataload/Insert
4) Dataload/Update
5) Incremental load
6) Data accuracy
7) verify Naming standards.
8) Verify column Mapping
-> The Unit Test will be carried by ETL developer in development phase.
-> ETL developer has to do the data validations also in this phase.
-> ETL developer has to do the data validations also in this phase.
Development Integration Testing -
- -> Run all the mappings in the sequence order.
- -> First Run the source to stage mappings.
- -> Then run the mappings related to dimensions and facts.
System Integration Testing :-
- -> After development phase,we have to move our code to QA environment.
- -> In this environment,we are giving read-only permission to testing people.
- -> They will test all the workflows.
- -> And they will test our code according to their standards.
User Acceptance Testing ( UAT ) :-
-> This test is carried out in the presence of client side technical users to verify the data migration from source to destination.