The use of a prototype system for evaluating knowledge elicitation techniques

Jones, Stephen; Miles, J. C.

Abstract

This paper describes the final phase of a research project aimed at investigating the efficacy of using two distinct methods of knowledge elicitation, comparing the knowledge obtained via classification or scaling techniques with that derived from the more traditional interview based approaches. It outlines the process of evaluating the knowledge elicited from an expert via a prototype specifically created for this purpose, the design of which was based directly on the findings of previous rapid prototyping approaches. The prototype was modelled to facilitate the evaluation of elicited knowledge along a numerical scale according to predetermined criteria. The use of the prototype resulted in the knowledge elicited via scaling methods receiving higher ratings than that obtained via non-scaling methods on the criteria of 'correctness' and 'relevance', although no significant difference was found between the two sets of data on the criterion of 'suitable for a knowledge based system'.

• Journal Article Type: Article
• Online Publication Date: Oct 9, 2008
• Publication Date: May 1, 1998
• Journal: Expert Systems
• Print ISSN: 0266-4720
• Electronic ISSN: 1468-0394
• Publisher: Wiley
• Peer Reviewed: Peer Reviewed
• Volume: 15
• Issue: 2
• Pages: 83-97
• DOI: https://doi.org/10.1111/1468-0394.00067
• Keywords: knowledge elicitation, knowledge based systems, evaluating techniques
• Public URL: https://uwe-repository.worktribe.com/output/1099791
• Publisher URL: http://dx.doi.org/10.1111/1468-0394.00067