Investigating Patterns of Rasch Item Estimates in Examination ...

Work thumb

Views: 266

  • Title: Investigating Patterns of Rasch Item Estimates in Examinations of Foundation English Courses: A Gradient Assumption Examined
  • Author(s): Kunlaphak Kongsuwannakul
  • Publisher: Common Ground Research Networks
  • Collection: Common Ground Research Networks
  • Series: The Learner
  • Journal Title: The International Journal of Assessment and Evaluation
  • Keywords: Rasch Models, Program Evaluation, Item Responses, Foundation English, Hierarchy
  • Volume: 28
  • Issue: 1
  • Date: April 21, 2021
  • ISSN: 2327-7920 (Print)
  • ISSN: 2327-8692 (Online)
  • DOI: https://doi.org/10.18848/2327-7920/CGP/v28i01/113-123
  • Citation: Kongsuwannakul, Kunlaphak . 2021. "Investigating Patterns of Rasch Item Estimates in Examinations of Foundation English Courses: A Gradient Assumption Examined." The International Journal of Assessment and Evaluation 28 (1): 113-123. doi:10.18848/2327-7920/CGP/v28i01/113-123.
  • Extent: 11 pages

All Rights Reserved

Copyright © 2021, Common Ground Research Networks, All Rights Reserved

Abstract

Rasch modeling has long been an approach for educational measurement. Nonetheless, a strategic review of recent “Educational Researcher” volumes and “Language Testing” issues reveals limited use of the approach, suggesting its full potential is yet to be realized. This article investigates patterns of Rasch item estimates in tests of foundation English courses at a university in Thailand. Not only could this draw attention of the academia to the approach, but it also potentially touches upon a little-researched area in program evaluation. It is hypothesized that the test items of the English examinations are of incremental difficulty, from the first prerequisite to the last course in the series of foundation English courses. Multiple Rasch analyses are performed on item responses, tackling a rebuttal to the validity argument. A key finding, however, is that the results are mixed: the tests of the courses are not always aligned in accordance with the expected gradient difficulty. Implications for the use of the approach and for the finding are also discussed. These include a call for more studies with Rasch modeling and a call for scrutinizing language courses and examinations that are administered as a series. A framework for dealing with null results is also advocated, whereby such findings ought to be articulated with clarity.