King's College London

Research portal

Clarifying the Scope of Generalizability Theory for Multifaceted Assessment

Research output: Contribution to journalArticlepeer-review

Duncan Jackson, George Michaelides, Chris Dewberry, Paul Englert

Original languageEnglish
JournalNEW ZEALAND JOURNAL OF PSYCHOLOGY
Accepted/In press2022

King's Authors

Abstract

Generalizability theory (G theory) continues to be underutilized in applied psychological research, both in New Zealand and internationally, possibly due to uncertainties about the types of questions that it can be used to address. G theory and its associated random effects model basis is often positioned as an approach limited to the study of reliability. In contrast, latent variable theory, and its confirmatory factor analytic (CFA) basis, is used more widely to address issues of validity whilst controlling for reliability. This study clarifies the types of questions to which G theory can be applied by testing whether there is any justification for the difference in interpretation between results based on G theory and latent variable theory. We reanalyzed data from an operational assessment center (N = 214 managerial assessees) and found comparable aggregated effects, generalizability coefficients, and latent scores across the G theory and latent variable theory approaches, suggesting that both can be applied to problems related to reliability and structural validity.

View graph of relations

© 2020 King's College London | Strand | London WC2R 2LS | England | United Kingdom | Tel +44 (0)20 7836 5454