TY - JOUR
T1 - Clarifying the Scope of Generalizability Theory for Multifaceted Assessment
AU - Jackson, Duncan J.R.
AU - Michaelides, George
AU - Dewberry, Chris
AU - Englert, Paul
N1 - Publisher Copyright:
© 2022 New Zealand Psychological Society. All rights reserved.
PY - 2022/8
Y1 - 2022/8
N2 - Generalizability theory (G theory) continues to be underutilized in applied psychological research, both in New Zealand and internationally, possibly due to uncertainties about the types of questions that it can be used to address. G theory and its associated random effects model basis is often positioned as an approach limited to the study of reliability. In contrast, latent variable theory, and its confirmatory factor analytic (CFA) basis, is used more widely to address issues of validity whilst controlling for reliability. This study clarifies the types of questions to which G theory can be applied by testing whether there is any justification for differences in interpretation between results based on G theory and latent variable theory. We reanalyzed data from an operational assessment center (N = 214 managerial assessees) and found comparable aggregated effects, generalizability coefficients, and latent scores across the G theory and latent variable theory approaches, suggesting that both can be applied to problems related to reliability and structural validity.
AB - Generalizability theory (G theory) continues to be underutilized in applied psychological research, both in New Zealand and internationally, possibly due to uncertainties about the types of questions that it can be used to address. G theory and its associated random effects model basis is often positioned as an approach limited to the study of reliability. In contrast, latent variable theory, and its confirmatory factor analytic (CFA) basis, is used more widely to address issues of validity whilst controlling for reliability. This study clarifies the types of questions to which G theory can be applied by testing whether there is any justification for differences in interpretation between results based on G theory and latent variable theory. We reanalyzed data from an operational assessment center (N = 214 managerial assessees) and found comparable aggregated effects, generalizability coefficients, and latent scores across the G theory and latent variable theory approaches, suggesting that both can be applied to problems related to reliability and structural validity.
KW - generalizability theory
KW - multifaceted assessment
KW - Psychological assessment
UR - http://www.scopus.com/inward/record.url?scp=85172907784&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:85172907784
SN - 0112-109X
VL - 51
SP - 53
EP - 64
JO - NEW ZEALAND JOURNAL OF PSYCHOLOGY
JF - NEW ZEALAND JOURNAL OF PSYCHOLOGY
IS - 2
ER -