Workflow orchestration and provenance management for neuroimaging research using CRISTAL

Branson, Andrew; McClatchey, Richard; Shamdasani, Jetendr; Habib, Irfan; Anjum, Ashiq; Bloodsworth, Peter; Munir, Kamran

Abstract

The workflow orchestration and traceability (or provenance) of data is essential in carrying out meaningful analyses of large scale neuroimaging datasets. In both the neuGRID and N4U projects the need for data provenance has been identified by the end-user research community as an essential requirement. We have addressed this through the provision of a Provenance Service and workflow orchestration whose description is the main contribution of this article. In the neuGRID project, a provenance service has been designed and implemented (using the CRISTAL software) that captures, stores, retrieves and reconstructs the workflow information needed to facilitate users in conducting neuroimaging analyses. The software enables neuroscientists to track the evolution of workflows (or pipelines) and datasets. It tracks the outcomes of various analyses and provides provenance traceability throughout the lifecycle of their studies thereby supporting the complex analyses underpinning neuroimaging research. Finally, the neuGRID Provenance Service and infrastructure has been evaluated in practice with clinical users and via a number of international data challenges.

• Working Paper Type: Working Paper
• Publication Date: Aug 1, 2012
• Journal: Future Generation Computer Systems
• Print ISSN: 0167-739X
• Peer Reviewed: Not Peer Reviewed
• Keywords: workflow planning, orchestration, provenance management, description-driven system, neuroimaging analysis
• Public URL: https://uwe-repository.worktribe.com/output/945057
• Publisher URL: http://www1.uwe.ac.uk/et/research/cccs/publications.aspx
• Related Public URLs: http://www.sciencedirect.com/science/journal/aip/0167739X