A hierarchical latent response model for inferences about examinee engagement in terms of guessing and item-level non-response.

A hierarchical latent response model for inferences about examinee engagement in terms of guessing and item-level non-response. Br J Math Stat Psychol. 2019 Nov 10;:e12188 Authors: Ulitzsch E, von Davier M, Pohl S Abstract In low-stakes assessments, test performance has few or no consequences for examinees themselves, so that examinees may not be fully engaged when answering the items. Instead of engaging in solution behaviour, disengaged examinees might randomly guess or generate no response at all. When ignored, examinee disengagement poses a severe threat to the validity of results obtained from low-stakes assessments. Statistical modelling approaches in educational measurement have been proposed that account for non-response or for guessing, but do not consider both types of disengaged behaviour simultaneously. We bring together research on modelling examinee engagement and research on missing values and present a hierarchical latent response model for identifying and modelling the processes associated with examinee disengagement jointly with the processes associated with engaged responses. To that end, we employ a mixture model that identifies disengagement at the item-by-examinee level by assuming different data-generating processes underlying item responses and omissions, respectively, as well as response times associated with engaged and disengaged behaviour. By modelling examinee engagement with a latent response framework, ...
Source: The British Journal of Mathematical and Statistical Psychology - Category: Statistics Authors: Tags: Br J Math Stat Psychol Source Type: research