Discovering the most important data quality dimensions in health big data using latent semantic analysis
Conference paper
Juddoo, S. and George, C. 2018. Discovering the most important data quality dimensions in health big data using latent semantic analysis. 2018 International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD). Durban, South Africa 06 - 07 Aug 2018 IEEE. https://doi.org/10.1109/ICABCD.2018.8465129
Type | Conference paper |
---|---|
Title | Discovering the most important data quality dimensions in health big data using latent semantic analysis |
Authors | Juddoo, S. and George, C. |
Abstract | Big Data quality is a field which is emerging. Many authors nowadays agree that data quality is still very relevant, even for Big Data uses. However, there is a lack of frameworks or guidelines focusing on how to carry out big data quality initiatives. The starting point of any data quality work is to determine the properties of data quality, termed ‘data quality dimensions’ (DQDs). Even these dimensions lack precise rigour in terms of definition in existing literature. This current research aims to contribute towards identifying the most important DQDs for big data in the health industry. It is a continuation of previous work, which, using relevant literature, identified five DQDs (accuracy, completeness, consistency, reliability and timeliness) as being the most important DQDs in health datasets. The previous work used a human judgement based research method known as an inner hermeneutic cycle (IHC). To remove the potential bias coming from the human judgement aspect, this research study used the same set of literature but applied a statistical research method (used to extract knowledge from a set of documents) known as latent semantic analysis (LSA). Use of LSA concluded that accuracy and completeness were the only similar DQDs classed as the most important in health Big Data for both IHC and LSA. |
Research Group | Aspects of Law and Ethics Related to Technology group |
Conference | 2018 International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD) |
ISBN | |
Hardcover | 9781538630600 |
Publisher | IEEE |
Publication dates | |
17 Sep 2018 | |
Publication process dates | |
Deposited | 09 Nov 2018 |
Accepted | 03 Jan 2018 |
Completed | 06 Aug 2018 |
Output status | Published |
Accepted author manuscript | |
Copyright Statement | © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Digital Object Identifier (DOI) | https://doi.org/10.1109/ICABCD.2018.8465129 |
Language | English |
Book title | 2018 International Conference on Advances in Big Data, Computing and Data Communication Systems (icABCD) |
https://repository.mdx.ac.uk/item/88041
Download files
54
total views23
total downloads4
views this month4
downloads this month