Abstract
This study reports on the development of both an analytic and a holistic rating scale for the purpose of effectively measuring test-takers’ English-Chinese News Trans-editing Competence (NTC). Following the construct of the NTC model, the paper proposes an analytic rating scale, which consists of three dimensions, namely content transferring, information editing, and language using. Each trait contains 5 bands. The holistic rating scale is adapted on the basis of Carroll’s 9-band holistic scale. The validity of the two scales was investigated by administrating a news trans-editing performance test to 60 examinees of different levels. Many-facet Rasch Model (MFRM) was later applied to analyze the scores awarded by 3 raters who adopted both the analytic and holistic scale on the same set of 60 news trans-edited versions. Statistics showed that (1) examinees were differentiated, but the analytic scales distinguished the subjects more accurately; (2) difference in rater severity was found among raters using the holistic scale, while there was no difference for analytic rating scale whose rater effects was smaller and inter-rater reliability higher; (3) the adjacent scales of analytic scale were more distinguishable. Generally speaking, the analytic rating scale performed better in measuring the NTC of candidates.
Key words
news trans-editing competence /
holistic rating scale /
analytic rating scale /
multi-faceted Rasch model
Cite this article
Download Citations
Development and validation of scoring rubric for news Trans-editing competence: A Rasch-based analysis[J]. Foreign Language Learning Theory and Practice. 2022, 179(3): 104
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}