Skip to main content

Research Repository

See what's under the surface

Advanced Search

Data provenance tracking as the basis for a biomedical virtual research environment

McClatchey, Richard

Authors



Abstract

In complex data analyses it is increasingly important to capture information about the usage of data sets in addition to their preservation over time to ensure reproducibility of results, to verify the work of others and to ensure appropriate conditions data have been used for specific analyses. Scientific workflow based studies are beginning to realize the benefit of capturing this provenance of data and the activities used to process, transform and carry out studies on those data. This is especially true in biomedicine where the collection of data through experiment is costly and/or difficult to reproduce and where that data needs to be preserved over time. One way to support the development of workflows and their use in (collaborative) biomedical analyses is through the use of a Virtual Research Environment. The dynamic and distributed nature of Grid/Cloud computing, however, makes the capture and processing of provenance information a major research challenge. Furthermore most workflow provenance management services are designed only for data-flow oriented workflows and researchers are now realising that tracking data or workflows alone or separately is insufficient to support the scientific process. What is required for collaborative research is traceable and reproducible provenance support in a full orchestrated Virtual Research Environment (VRE) that enables researchers to define their studies in terms of the datasets and processes used, to monitor and visualize the outcome of their analyses and to log their results so that others users can call upon that acquired knowledge to support subsequent studies. We have extended the work carried out in the neuGRID and N4U projects in providing a so-called Virtual Laboratory to provide the foundation for a generic VRE in which sets of biomedical data (images, laboratory test results, patient records, epidemiological analyses etc.) and the workflows (pipelines) used to process those data, together with their provenance data and results sets are captured in the CRISTAL software. This paper outlines the functionality provided for a VRE by the Open Source CRISTAL software and examines how that can provide the foundations for a practice-based knowledge base for biomedicine and, potentially, for a wider research community.

Journal Article Type Article
Start Date Mar 5, 2017
Publication Date Jan 1, 2018
Journal Proceedings of Science
Print ISSN 1824-8039
Peer Reviewed Peer Reviewed
Volume 293
APA6 Citation McClatchey, R. (2018). Data provenance tracking as the basis for a biomedical virtual research environment. Proceedings of Science, 293,
Keywords data provenance tracking, biomedical, virtual research environment
Publisher URL https://pos.sissa.it/
Additional Information Title of Conference or Conference Proceedings : International Symposium on Grids and Clouds 2017 (ISGC 2017)

Files







You might also like



Downloadable Citations

;