Skip to main content

Research Repository

Advanced Search

Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project

Khan, Zaheer; Ludlow, David; Rix, Joachim

Authors

Zaheer Khan Zaheer2.Khan@uwe.ac.uk
Professor in Computer Science

David Ludlow David.Ludlow@uwe.ac.uk
Professor in European Smart Cities

Joachim Rix



Abstract

Evaluating an Information Technology (IT) based research and development project from an end-user's perspective is necessary in order to discover whether or not the outcomes of the project are successful. However, it is not straightforward to design and implement a generic user evaluation methodology that can be applied to a large-scale collaborative integrated research and development project. In this article, we share our experience based on the research evaluation carried out in a large-scale integrated ICT research project - The HUMBOLDT project. The project develops IT tools and services for cross-border geospatial data harmonization, which are applied to nine different application scenarios. A novel user-oriented evaluation methodology, namely - Criteria Indicators and Metrics (CIM) - is defined and utilized for the evaluation of the project research outcomes. The user evaluation results reveal the extent to which the research and development objectives of the project are achieved, and also demonstrate the benefits and limitations of the evaluation methodology. The results of this article can be usefully applied to other collaborative research projects in a variety of domains. © The Author 2012. Published by Oxford University Press. All rights reserved.

Citation

Khan, Z., Ludlow, D., & Rix, J. (2013). Applying the criteria indicators and metrics evaluation method on ICT research: The HUMBOLDT project. Research Evaluation, 22(1), 30-40. https://doi.org/10.1093/reseval/rvs037

Journal Article Type Article
Publication Date Mar 1, 2013
Journal Research Evaluation
Print ISSN 0958-2029
Electronic ISSN 1471-5449
Publisher Oxford University Press (OUP)
Peer Reviewed Peer Reviewed
Volume 22
Issue 1
Pages 30-40
DOI https://doi.org/10.1093/reseval/rvs037
Keywords IT research and development, collaborative IT projects, evaluation stakeholders, IT research project evaluation, user based evaluation methodology, criteria indicators and metrics
Public URL https://uwe-repository.worktribe.com/output/941334
Publisher URL http://dx.doi.org/10.1093/reseval/rvs037