Data Quality Indicators Composition and Calculus: Engineering and Information Systems Approaches

Sensors & Transducers

Sergey Edward LYSHEVSKI¹  Leon REZNIK² 

[1]Department of Electrical and Microelectronic Engineering Rochester Institute of Technology, 102 Lomb Memorial Drive, Rochester, NY 14623, USA

[2]Department of Computer Science,Rochester Institute of Technology, 102 Lomb Memorial Drive, Rochester, NY 14623, USA

关键词: Data quality;    Quality evaluation;    Computer security evaluation;    Sensor systems;    Nanotechnology.;   

DOI  :  

来源: DOAJ

【 摘 要 】

Big Data phenomenon is a result of novel technological developments in sensor, computer and communication technologies. Nowadays more and more data are produced by nanoscale photonic, optoelectronic and electronic devices. However, their quality characteristics could be very low. The paper proposes new methods of the data management with huge data amounts that is based on associating of data quality indicators with each data entity. To achieve this goal, one needs to define the composition of the data quality indicators and to develop their integration calculus. As data quality evaluation involves multi-disciplinary research, various metrics have been investigated. The paper describes two major approaches in assigning the data quality indicators and developing their integration calculus. The information systems approach employs traditional high-level metrics like data accuracy, consistency and completeness. The engineering approach utilizes signal characteristics processed with the probability based calculus. The data quality metrics composition and calculus are discussed. The tools developed to automate the metrics selection and calculus procedures are presented. The user- friendly interface examples are provided.

【 授权许可】

Unknown