Role of Assistant Examiners in Marker Behaviour Modification during Onscreen Marking

Role of Assistant Examiners in Marker Behaviour Modification during Onscreen Marking

[featured_image]
  • Version
  • Download 135
  • File Size 401.53 KB
  • File Count 1
  • Create Date August 2, 2018
  • Last Updated August 2, 2018

Role of Assistant Examiners in Marker Behaviour Modification during Onscreen Marking

This study investigated the effectiveness of the assistant examiners’, (AEs) under instant ,feedback conditions during onscreen marking (OSM) of the written components of Chinese Language and English Language at Primary 6 (Grade 6) in the Hong Kong’,s Territory-wide System Assessment (TSA). The OSM was first adopted for marking TSA papers in 2008. It is held centrally for two weeks per year at a Hong Kong Examinations and Assessment Authority marking centre. During OSM, the AEs monitor the markers’, performance by check-marking the marked scripts on the spot and identifying problematic scripts using these instant statistical figures: 1) marking speed, 2) percentage of third-mark triggering, 3) leniency/severity of each marker, 4) rating distribution of each marker. AEs also have meetings with all markers on standardization using the aforementioned figures to contextualize live scripts. AEs’, interventions are immediately triggered when markers show inconsistency and/or idiosyncratic ratings. For this study, a questionnaire was completed by AEs on the use of OSM. Both the quantitative data from the instant statistics and the qualitative data from the questionnaires indicated that modification of marker behaviour was evident and a strong congruence was observed among markers over the past few years.  ,  ,  , ,Key words: onscreen marking, rater characteristics, language assessment

Attached Files

FileAction
paper_226e234b8d.pdfDownload