Automatic generation of data merging program codes

Data merging is an essential part of ETL (Extract-Transform-Load) processes to build a data warehouse system. To avoid rewheeling merging techniques, we propose a Data Merging Meta-model (DMM) and its transformation into executable program codes in the manner of model driven engineering. DMM allows defining relationships of different model entities and their merging types in conceptual level. Our formalized transformation described using ATL (ATLAS Transformation Language) enables automatic generation of PL/SQL packages to execute data merging in commercial ETL tools. With this approach data warehouse engineers can be relieved from the burden of repetitive complex script coding and the pain of maintaining consistency of design and implementation.

This is an author produced version of a conference paper included in this repository with permission. The final paper is published by SCITEPRESS as: Kim, H.; Oussena, S.; zhang, Y. and Clark, T. (2010). AUTOMATIC GENERATION OF DATA MERGING PROGRAM CODES. In Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT; ISBN 978-989-8425-23-2; ISSN 2184-2833, SciTePress, pages 179-186. DOI: 10.5220/0003008301790186