Toggle Main Menu Toggle Search

Open Access padlockePrints

Why-Diff: Exploiting Provenance to Understand Outcome Differences from Non-Identical Reproduced Workflows

Lookup NU author(s): Priyaa Thavasimani, Dr Jacek Cala, Dr Paolo Missier

Downloads


Licence

This is the final published version of an article that has been published in its final definitive form by IEEE, 2019.

For re-use rights please refer to the publisher's terms and conditions.


Abstract

© 2013 IEEE. Data analytics processes such as scientific workflows tend to be executed repeatedly, with varying dependencies and input datasets. The case has been made in the past for tracking the provenance of the final information products through the workflow steps, to enable their reproducibility. In this paper, we explore the hypothesis that provenance traces recorded during execution are also instrumental to answering questions about the observed differences between sets of results obtained from similar but not identical workflow configurations. Such differences in configurations may be introduced deliberately, i.e., to explore process variations or accidentally, typically as the result of porting efforts or of changes in the computing environment. Using a commonly used workflow programming model as a reference, we consider both structural variations in the workflows as well as variations within their individual components. Our why-diff algorithm compares the graph representations of two provenance traces derived from two workflow variations. It produces a delta graph that can be used to produce human-readable explanations of the impact of workflow differences on observed output differences. We report with Neo4j graph database. Further, we report explanations of the difference between workflow results using a suite of synthetic workflows as well as real-world workflows.


Publication metadata

Author(s): Thavasimani P, Cała J, Missier P

Publication type: Article

Publication status: Published

Journal: IEEE Access

Year: 2019

Volume: 7

Pages: 34973-34990

Online publication date: 07/03/2019

Acceptance date: 24/02/2019

Date deposited: 23/04/2019

ISSN (electronic): 2169-3536

Publisher: IEEE

URL: https://doi.org/10.1109/ACCESS.2019.2903727

DOI: 10.1109/ACCESS.2019.2903727


Altmetrics

Altmetrics provided by Altmetric


Actions

Find at Newcastle University icon    Link to this publication


Share