Computer-aided Assessment Standardisation for Writing and Oral Presentation Assessments: Design, Development and Implementation
Keywords:
computer-aided assessment standardisation; ROLE- and CASE-based concepts; writing and oral presentation assessments; holistic and component gradingAbstract
Computer-aided assessment (CAA) has been widely applied
to summative assessments in English language teaching and learning.
However, its usage is limited to computer-marked exercises, e.g.
multiple choice questions or short answers. Assessments on essay
writing or oral presentation are still lacking without human
intervention. In addition, computer-aided tools for assessment
benchmarking have been commonly neglected. This should be of
concern to IT specialists when facilitating language assessment through
technology. An online English language assessment standardisation
platform (ELCAS) was introduced to reduce discrepancies among raters.
The platform was further developed, and adopted by the English
Language Centre, Hong Kong Polytechnic University for several years,
and the project team won a Faculty Award in 2009 for its outstanding
performance in developing this online assessment benchmarking tool to
assist teachers in achieving consistency and inter-rater reliability in
grading assessed assignments. The primary contribution of this paper is
to share the ideas and design of the platform, experience of its
development, and the problems encountered during implementation
which are of interest for CAA standardisation.
References
Aamodt, A. & Plaza, E. (1994). Case-Based Reasoning: Foundational Issues,
Methodological Variations, and System Approaches. Artificial Intelligence
Communications 7(1), 39-52.
Lewis, J.P. (2005). Project Planning, Scheduling & Control. 4E. McGraw Hill. ISBN 978-0-
-146037-8.
Barkaoui, K. (2007). Rating scale impact on EFL essay marking: A mixed-method study.
Assessing Wriitng, 12(2), 86-107.
Li, V. (2010). eSelf-assessment: A case study in English language learning (Hong Kong)
for enhancing Writing and Oral Presentation Skills. Education Technology and Computer (ICETC), 2010 2nd International Conference, 4, 371-375, 22-24 June
, Shanghai. ISBN: 978-1-4244-6367-1, DOI: 10.1109/ICETC.2010.5529662.
Lorenz, E. (2000). The Butterfuly Effect, in R. H. Abraham & Y. Ueda (Ed.), The Chaos
Avant-garde: Memories of the Early Days of Chaos Theory, World Scientific
Publishing Co. Pte. Ltd., 91-94.
Sandhu, R., Coyne, E.J., Feinstein, H.L. & Youman, C.E. (1996). Role-Based Access
Control Models. IEEE Computer, 29(2), 38–47.
Schaefer, E. (2008). Rater bias patterns in an EFL writing assessment. Language Testing,
(4), 465-493.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2014 Voyce Li
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).
