PETS口试评分培训效果的多面Rasch分析

李英, 关丹丹

外语教学理论与实践 ›› 2016, Vol. 153 ›› Issue (3) : 43.

外语教学理论与实践 ›› 2016, Vol. 153 ›› Issue (3) : 43.
实践研究

PETS口试评分培训效果的多面Rasch分析

作者信息 +

Study on the Effects of Rater Training for PETS Speaking Tests with Many-Facet Rasch Model

Author information +
文章历史 +

摘要

本研究以PETS-1级拟聘口试教师为研究对象,对口试教师评分的培训效果进行了研究。采用多面Rasch分析对比口试教师接受培训前后的评分效果。结果发现:培训后,提升了口试教师与专家评分完全一致的比率,评分偏于严格的口试教师在评分标准上做了恰当的调整,所有口试教师评分拟合值都在可接受范围内,总体上,口试教师评分的培训比较有效,培训后提升了评分的准确性。多面Rasch分析有助于发现评分过于宽松、过于严格、评分拟合差的口试教师以及评分异常情况,为开展有针对性地培训提供了可靠的依据。

Abstract

This article describes a study conducted to explore rater training effects of the inexperienced raters on speaking tests, Public English Test System Level 1 (PETS-1), by comparing the quality of scoring before and after training with Many-Facet Rasch Analysis. The analysis shows that, the raters achieve a significant increase in exact agreement percentage between inexperienced raters and expert judges after training. After training, too strict teacher ratings on speaking made appropriate adjustments, all teachers get the good Infit and Outfit values which are within the acceptable range. In general, rater training for PETS speaking tests reveals positive effects and ratings are improved. Many-Facet Rasch analysis helps discover too loose, too strict, and poor fitting raters, as well as abnormal scoring, which all provide a reliable basis for carrying out targeted training to raters.

关键词

/ font-family: 宋体 / mso-bidi-font-family: 'Times New Roman' / mso-font-kerning: 1.0pt / mso-ansi-language: EN-US / mso-fareast-language: ZH-CN / mso-bidi-language: AR-SA / mso-ascii-font-family: 'Times New Roman' / mso-hansi-font-family: 'Times New Roman'">PETS / 口试 / 评分 / 培训效果 / 多面Rasch分析

Key words

 PETS / speaking test / rating / training effect / Many-Facet Rasch Model

引用本文

导出引用
李英, 关丹丹. PETS口试评分培训效果的多面Rasch分析[J]. 外语教学理论与实践. 2016, 153(3): 43
LI Ying, GUAN Dan-Dan. Study on the Effects of Rater Training for PETS Speaking Tests with Many-Facet Rasch Model[J]. Foreign Language Learning Theory and Practice. 2016, 153(3): 43

Accesses

Citation

Detail

段落导航
相关文章

/