Process data in computer-based assessment: Challenges and opportunities in opening the black box.

European Journal of Psychological Assessment, Vol 39(4), 2023, 241-251; doi:10.1027/1015-5759/a000790This editorial provides a comprehensive framework and overview of potential uses and next steps in research on process data in computer-based assessments, expanding toward broad perspectives on the field and an exploration of future directions and emerging trends. After briefly reflecting on the evolution of process data use in research and assessment practice, we discuss three key challenges, namely (1) the theoretical grounding and validation of process data indicators, (2) assessment design for process data, and (3) ethical standards. By considering best practice approaches in all three areas and current discussions in the literature, we conclude that a focus is needed on the following three areas: (1) strong, holistic theoretical frameworks for validating process data, (2) reliable, standardized data collections, preferably with a top-down approach to developing test items and preregistered hypotheses, and (3) ethical norms for data collection, data use, and guidelines for responsible inference, including restraints in decisions based on process data. (PsycInfo Database Record (c) 2023 APA, all rights reserved)
Source: European Journal of Psychological Assessment - Category: Psychiatry & Psychology Source Type: research