On the appropriate granularity of activities in a scientific workflow applied to an optimization problem

Jean Michel Perraud*, Qifeng Bai, David Hehir

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Scientific workflow management is an active area of research and development responding to an increase in the complexity of computational models, data analysis and data size. In the authors' experience, the distinction between scientific workflow software (SWS) and modelling frameworks or toolsets is at best not clear in the minds of users or developers, at least in the hydrology domain where the interest in concept of scientific workflow appears rather recent. It is understandably tempting for some users to assume that these new software tools aim to replace their existing modelling tools, with varying expectation depending on their prior satisfaction. While it is arguably clear that SWS can play a role in improving practices for high-level orchestration and traceability of scientific workflows, we explore in this paper the granularity at which activities can be usefully defined. We describe a case study, the calibration of a model, wrapping the components of a modelling framework (TIME) from the Trident and Kepler SWS. The problem is decomposed in several workflows comprising activities of differing granularities. We assess each approach against a set of criteria such as runtime performance and flexibility, discuss the feasibility and trade-off. The main findings are the design benefits stemming from having to clearly identify separate activities in the process, and that the difficulty of decomposing the optimization problem into finer-grained activities increases most markedly when needing iterative control flow capabilities.

Original languageEnglish
Title of host publicationModelling for Environment's Sake
Subtitle of host publicationProceedings of the 5th Biennial Conference of the International Environmental Modelling and Software Society, iEMSs 2010
Pages1578-1586
Number of pages9
Publication statusPublished - 2010
Externally publishedYes
Event5th Biennial Conference of the International Environmental Modelling and Software Society: Modelling for Environment's Sake, iEMSs 2010 - Ottawa, ON, Canada
Duration: 5 Jul 20108 Jul 2010

Publication series

NameModelling for Environment's Sake: Proceedings of the 5th Biennial Conference of the International Environmental Modelling and Software Society, iEMSs 2010
Volume2

Conference

Conference5th Biennial Conference of the International Environmental Modelling and Software Society: Modelling for Environment's Sake, iEMSs 2010
Country/TerritoryCanada
CityOttawa, ON
Period5/07/108/07/10

Fingerprint

Dive into the research topics of 'On the appropriate granularity of activities in a scientific workflow applied to an optimization problem'. Together they form a unique fingerprint.

Cite this