About Open Access
Incremental workflow improvement through analysis of its data provenance
Lookup NU author(s)
Dr Paolo Missier
Buneman, P., Freire, J.
Conference Proceedings (inc. Abstract)
3rd USENIX Workshop on the Theory and Practice of Provenance (TaPP)
Heraklion, Crete, Greece
Year of Conference
20-21 June 2011
Full text for this publication is not currently held within this repository. Alternative links are provided below where available.
Repeated executions of resource-intensive workflows over a large number of runs are commonly observed in e-science practice. We explore the hypothesis that, in some cases, provenance traces recorded for past runs of a workflow can be used to make future runs more efficient. This investigation is an initial step into the systematic study of the role that provenance analysis can play in the broader context of self-managing software systems. We have tested our hypothesis on a concrete case study involving a Chemical Engineering workflow deployed on a cloud infrastructure, where we can measure the cost of its repeated execution. Our approach involves augmenting the workflow with a feedback loop in which incremental analysis of the provenance of past runs is used to control some of the workflow steps in subsequent executions. We present initial experimental results and hint at future improvements as part of ongoing work.
Newcastle University Library, NE2 4HQ, United Kingdom. Tel: 0044 (191) 222 7657
©2011 Newcastle University Library