Toggle Main Menu Toggle Search

Open Access padlockePrints

Automated marking of longer computational questions in engineering subjects

Lookup NU author(s): Dr Christopher PearsonORCiD, Dr Nigel Penna

Downloads


Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND).


Abstract

E-assessments are becoming increasingly common and progressively more complex. Consequently, how these longer, more complex questions are designed and marked is imperative. This article uses the NUMBAS e-assessment tool to investigate the best practice for creating longer questions and their mark schemes on surveying modules taken by engineering students at Newcastle University. Automated marking enables calculation of follow through marks when incorrect answers are used in subsequent parts. However, awarding follow through marks with no further penalty for solutions being fundamentally incorrect leads to non-normally distributed marks. Consequently, it was found that follow through marks should be awarded at 25% or 50% of the total available to produce a normal distribution. Appropriate question design is vital to enable automated method marking in longer style e-assessment with questions being split into multiple steps. Longer calculation questions split into too few parts led to all or nothing style questions and subsequently bi-modal mark distributions, whilst questions separated into too many parts provided too much guidance to students so did not adequately assess the learning outcomes, leading to unnaturally high marks. To balance these factors, we found that longer questions should be split into approximately 3–4 parts, although this is application dependent.


Publication metadata

Author(s): Pearson C, Penna N

Publication type: Article

Publication status: Published

Journal: Assessment and Evaluation in Higher Education

Year: 2023

Volume: 48

Issue: 7

Pages: 915-925

Online publication date: 12/11/2022

Acceptance date: 02/11/2022

Date deposited: 12/11/2022

ISSN (print): 0260-2938

ISSN (electronic): 1469-297X

Publisher: Taylor and Francis

URL: https://doi.org/10.1080/02602938.2022.2144801

DOI: 10.1080/02602938.2022.2144801


Altmetrics

Altmetrics provided by Altmetric


Share