Skip to main content

When Should I Use a Measure to Support Instructional Improvement at Scale? The Importance of Considering Both Intended and Actual Use in Validity Arguments

Item

Title
When Should I Use a Measure to Support Instructional Improvement at Scale? The Importance of Considering Both Intended and Actual Use in Validity Arguments
Abstract/Description
Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument has historically focused on the intended interpretation and use. There has been a press to consider both the intended and actual interpretations and how users make sense of the data when constructing validity arguments, but the practice is not widespread. This paper contributes to existing research on validity by highlighting the value of attending to the actual interpretation and use of a measure aimed at supporting instructional improvement in mathematics. We describe the use of the same measure across two contexts to highlight the importance of attending to characteristics of both users and the contexts in which the measures are used when assessing the validity of inferences for the purpose of instructional improvement efforts.
Date
2021
In publication
Educational Measurement: Issues and Practice
Volume
40
Issue
1
Pages
92-100
Resource type
en
Resource status/form
en
Scholarship genre
en
IRE Approach/Concept
Instructional Improvement
Validity
Measurement for Improvement
Improvement at Scale
Data Use
Sensemaking/Interpretation
Featured case/project
PRM2 Team
Language
en
Open access/full-text available
en Yes
Peer reviewed
en Yes
ISSN
1745-3992
Citation
Ing, M., Chinen, S., Jackson, K., & Smith, T. M. (2021). When Should I Use a Measure to Support Instructional Improvement at Scale? The Importance of Considering Both Intended and Actual Use in Validity Arguments. Educational Measurement: Issues and Practice, 40(1), 92–100. https://doi.org/10.1111/emip.12393

Export

Comments

No comment yet! Be the first to add one!

I agree with terms of use and I accept to free my contribution under the licence CC BY-SA.

New Tags

I agree with terms of use and I accept to free my contribution under the licence CC BY-SA.