Assessing data change in scientific datasets.
Average rating votes
MetadataShow full item record
Scientific datasets are growing rapidly and becoming critical to next‐generation scientific discoveries. The validity of scientific results relies on the quality of data used and data are often subject to change, for example, due to observation additions, quality assessments, or processing software updates. The effects of data change are not well understood and difficult to predict. Datasets are often repeatedly updated and recomputing derived data products quickly becomes time consuming and resource intensive and may in some cases not even be necessary, thus delaying scientific advance. Despite its importance, there is a lack of systematic approaches for best comparing data versions to quantify the changes, and ad‐hoc or manual processes are commonly used. In this article, we propose a novel hierarchical approach for analyzing data changes, including real‐time (online) and offline analyses. We employ a variety of fast‐to‐compute numerical analyses, graphical data change representation.....
JournalConcurrency and Computational Practice and Experience
Best Practice TypeManual (incl. handbook, guide, cookbook etc)
CitationMüller, J., Faybishenko, B., Agarwal, D., et al (2021) Assessing data change in scientific datasets. Concurrency and Computaional Practice and Experience, e6245, 22pp. DOI: https://doi.org/10.1002/cpe.6245
The following license files are associated with this item:
Except where otherwise noted, this item's license is described as Attribution-NonCommercial-NoDerivatives 4.0 International