Automated essay scoring (AES); A semantic analysis inspired machine learning approach: An automated essay scoring system using semantic analysis and machine learning is presented in this research

Ikram, Ahsan; Castle, Billy

Abstract

With the advancements in Artificial Intelligence (AI), ‘Automated Essay Scoring’ (AES) systems have become more and more prevalent in recent years. This research proposes an extension to the Coh-Metrix algorithm AES, with a focus on feature lists. Technical features, such as, referential cohesion, lexical diversity, and syntactic complexity are evaluated. Furthermore, it proposes the use of four novel semantic measures, including estimating the topic overlap between an essay and its brief. A prototype implementation, using neural networks, is used to test the individual and comparative performance of the newly proposed AES system. The results show a considerable improvement on the results obtained in the existing research for the original Coh-Metrix algorithm; from an adjacent accuracy of 91%, to an adjacent accuracy of 97.5% (and a QWK of 0.822). This suggests that the new features and the proposed system have the potential to improve essay grading and would be a good area for further research

• Presentation Conference Type: Conference Paper (published)
• Conference Name: ICETC'20: 2020 12th International Conference on Education Technology and Computers
• Start Date: Oct 23, 2020
• End Date: Oct 26, 2020
• Acceptance Date: Oct 1, 2020
• Online Publication Date: Mar 6, 2021
• Publication Date: Mar 6, 2021
• Deposit Date: Feb 21, 2023
• Publisher: Association for Computing Machinery (ACM)
• Pages: 147-151
• Book Title: ICETC '20: Proceedings of the 12th International Conference on Education Technology and Computers
• DOI: https://doi.org/10.1145/3436756.3437036
• Public URL: https://uwe-repository.worktribe.com/output/10477864
• Publisher URL: https://dl.acm.org/doi/10.1145/3436756.3437036
• Related Public URLs: https://dl.acm.org/doi/proceedings/10.1145/3436756