The In-Task Assessment Framework for Behavioral Data
Item
- Title
- The In-Task Assessment Framework for Behavioral Data
- Abstract/Description
- In educational games and simulations, game play itself can provide a novel source of assessment data as it can offer rich observations of student learning behaviors, which can support diagnostic claims about students’ learning processes. However, the nature of the data produced by these environments makes using in-task behavioral data for assessment purposes difficult. We introduce the in-task assessment framework as an innovative approach for identifying the measurable components of the domain of interest, which is a process for feature extraction that operationalizes the concepts of interest at the same grain-size as contained in the log data and articulates chains-of-evidence that link the extracted features to applicable concepts in an ontology. This process transforms low-level log data into a set of action set labels that can be utilized in a number of different measurement models so that proficiency can be assessed solely from in-task behavioral data.
- Date
- In publication
- The Wiley Handbook of Cognition and Assessment
- Pages
- 472-507
- Publisher
- John Wiley & Sons, Ltd
- Resource type
- en Research/Scholarly Media
- Resource status/form
- en Published Text
- Scholarship genre
- en Theoretical
- Keywords
- assessment
- assessment framework
- behavioral data
- collaborative problem solving
- educational games
- evidence-centered design
- feature extraction
- measurement
- process data
- simulations
- Language
- en
- Open access/full-text available
- en Yes
- Peer reviewed
- en Yes
- ISBN
- 978-1-118-95658-8
- URL
- Official Publisher's Webpage (Wiley Online Library)
- Full-text PDF Shared by Author (ResearchGate)
- Citation
- Kerr, D., Andrews, J. J., & Mislevy, R. J. (2016). The In-Task Assessment Framework for Behavioral Data. In The Wiley Handbook of Cognition and Assessment (pp. 472–507). John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118956588.ch20
- Item sets
- Handbook Chapter 20 Citations
Annotations
There are no annotations for this resource.