Content validation and rubric development of language tools tested in multi-state multi-language project: Challenges Faced

Content validation and rubric development of language tools tested in multi-state multi-language project: Challenges Faced

[featured_image]
  • Version
  • Download 165
  • File Size 986.10 KB
  • File Count 1
  • Create Date August 2, 2018
  • Last Updated August 2, 2018

Content validation and rubric development of language tools tested in multi-state multi-language project: Challenges Faced

Validity of tools is a key issue in large scale assessments. For any assessment to have its valid impact, the inferences and decisions made on the basis of assessments should be well-founded. To ensure this, the content, construct, testing procedures and analysis procedures have to be validated. As such a complex feature, validity of tools enters a different paradigm when the tools have to be tested in multiple states of India in various vernacular languages. While mathematical tools require simpler adaptation and precise translation in other languages, for language testing, the tools developed should be validated for cultural and linguistic purposes as well. Questions where the construct includes skills like identifying letters and sounds, word usage, grammar and comprehension, mere translation in vernacular language may not suffice. More than translation it is trans-creation and adaptation of tools in that language, while maintaining the difficulty levels. This requires various validity checks. The paper focuses on a case study of a project funded by an international organization working on children education and welfare. As part of the project, the tools were developed and administered for grades 2 &, 3 in 7 different states of India in 5 different vernacular languages. Various validity checks including harmonization of tools, constructs, difficulty levels and pilot testing were employed to ensure uniformity and efficacy of the assessment. The paper lists out challenges faced and remedies worked out to ensure that the objective of the assessment was achieved.

Attached Files

FileAction
paper_3fcb33ca3.pdfDownload