• Version
• Download 511
• File Size 567.14 KB
• File Count 1
• Create Date August 2, 2018
• Last Updated August 2, 2018

Evaluating the rank-ordering method for standard maintaining

The rank-ordering method for standard-maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the mark scale of another test, using holistic expert judgments about the quality of exemplars of candidates’, work (scripts). How should a method like this be evaluated? If the correct mapping were known, then the outcome of a rank-ordering exercise could be compared against that.However, in the contexts for which the method was designed, there is no ‘,right answer’,.This paper presents an evaluation of the rank-ordering method in terms of its rationale, its psychological validity, and the stability of the outcome when various factors incidental to themethod are varied (e.g. the number of judges, the number of scripts to be ranked, methods of data modelling and analysis).

Attached Files