Data discovery method for Extract- Transform-Load

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
Date
2019-05-09
Major/Subject
Mcode
Degree programme
Language
en
Pages
8
174-181
Series
2019 IEEE 10th International Conference on Mechanical and Intelligent Manufacturing Technologies, ICMIMT 2019
Abstract
Information Systems (ISs) are fundamental to streamline operations and support processes of any modern enterprise. Being able to perform analytics over the data managed in various enterprise ISs is becoming increasingly important for organisational growth. Extract, Transform, and Load (ETL) are the necessary pre-processing steps of any data mining activity. Due to the complexity of modern IS, extracting data is becoming increasingly complicated and time-consuming. In order to ease the process, this paper proposes a methodology and a pilot implementation, that aims to simplify data extraction process by leveraging the end-users' knowledge and understanding of the specific IS. This paper first provides a brief introduction and the current state of the art regarding existing ETL process and techniques. Then, it explains in details the proposed methodology. Finally, test results of typical data-extraction tasks from four commercial ISs are reported.
Description
| openaire: EC/H2020/688203/EU//BIoTope
Keywords
Data Discovery, Data Warehouse, Database, ETL, Information Retrieval, Information System, Process Mapping, Reverse Engineering, Trigger
Other note
Citation
Madhikerrni , M & Främling , K 2019 , Data discovery method for Extract- Transform-Load . in 2019 IEEE 10th International Conference on Mechanical and Intelligent Manufacturing Technologies, ICMIMT 2019 . , 8712027 , IEEE , pp. 174-181 , IEEE International Conference on Mechanical and Intelligent Manufacturing Technologies , Cape Town , South Africa , 15/02/2019 . https://doi.org/10.1109/ICMIMT.2019.8712027