Obmaaq: Ontology-based model for automated assessment of short-answer questions

Ramnarain-Seetohul, Vidasha; Bassoo, Vandana; Rosunally, Yasmine

Abstract

Automated scoring of short answers is becoming increasingly important nowadays, as more classes are taking place online due to COVID-19 outbreaks. Over the past 50 years, different techniques have been applied to develop ways of assessing short answers automatically. The automated assessment of short answer questions has been used with varying kinds of questions in different domains. However, no interoperable tools have been developed to facilitate the automated assessment of short answers for common modules across educational institutions. In this paper, we present a novel system called OBMAAQ, which grades short answers for questions designed according to Bloom's revised taxonomy remember category. The proposed system uses publicly available domain ontologies to grade short answers in different subject areas. This method is unique as it does not use model answers since it relies solely on the domain ontologies by utilizing an ontology-based pruning technique to grade the students' responses. The purpose of the system is to allow teachers from different educational institutions to use a similar approach when assessing the short answers for common modules automatically. Two publicly available domain ontologies in the field of security and computer networks have been used to validate students' answers. Experimental results based on both datasets indicate some promising results even though it is less than the set thresholds. This paper discusses the lessons learned and future recommendations based on the OBMAAQ model.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2023 First International Conference on Advances in Electrical, Electronics and Computational Intelligence (ICAEECI)
• Start Date: Oct 19, 2023
• End Date: Oct 20, 2023
• Acceptance Date: Aug 22, 2023
• Online Publication Date: Jan 3, 2024
• Deposit Date: Feb 7, 2024
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• Book Title: 2023 First International Conference on Advances in Electrical, Electronics and Computational Intelligence (ICAEECI)
• ISBN: 9798350342802
• DOI: https://doi.org/10.1109/ICAEECI58247.2023.10370992
• Public URL: https://uwe-repository.worktribe.com/output/11606414