TY - JOUR
T1 - Evaluating CBT Clinical Competence with Standardised Role Plays and Patient Therapy Sessions
AU - Liness, Sheena
AU - Beale, Sarah Frances
AU - Lea, Susan
AU - Byrne, Suzanne
AU - Hirsch, Colette Rosanne
AU - Clark, David M.
PY - 2019/12/1
Y1 - 2019/12/1
N2 - Standardised role-plays (SR) have been proposed as an alternative to recordings of patients’ therapy sessions (PTS) to assess therapist competence during CBT training. This study compared the following properties of SR assessments with established PTS assessments: interrater reliability, responsiveness to training, convergent validity of competence ratings, and predictive validity for academic outcomes. SR and PTS were both rated using the Cognitive Therapy Scale Revised (CTS-R) to assess CBT trainees’ (n = 88) level of competence at the beginning and end of training, and at one-year follow-up. Both methods demonstrated excellent inter-rater reliability between pairs of course tutors (ICC range = .81–.93) and good reliability between tutors and an external assessor (ICC range = .71–.74). CTS-R scores for both SR and PTS increased across training to reach the competence threshold and remained stable at follow-up. However, there was only a weak relationship between the two assessment methods. Further refinement of SR as a CBT assessment method is indicated.
AB - Standardised role-plays (SR) have been proposed as an alternative to recordings of patients’ therapy sessions (PTS) to assess therapist competence during CBT training. This study compared the following properties of SR assessments with established PTS assessments: interrater reliability, responsiveness to training, convergent validity of competence ratings, and predictive validity for academic outcomes. SR and PTS were both rated using the Cognitive Therapy Scale Revised (CTS-R) to assess CBT trainees’ (n = 88) level of competence at the beginning and end of training, and at one-year follow-up. Both methods demonstrated excellent inter-rater reliability between pairs of course tutors (ICC range = .81–.93) and good reliability between tutors and an external assessor (ICC range = .71–.74). CTS-R scores for both SR and PTS increased across training to reach the competence threshold and remained stable at follow-up. However, there was only a weak relationship between the two assessment methods. Further refinement of SR as a CBT assessment method is indicated.
KW - Cognitive behaviour therapy (CBT)
KW - Competence
KW - IAPT
KW - Patient recordings
KW - Standardised role play
UR - http://www.scopus.com/inward/record.url?scp=85067680697&partnerID=8YFLogxK
U2 - 10.1007/s10608-019-10024-z
DO - 10.1007/s10608-019-10024-z
M3 - Article
SN - 0147-5916
VL - 43
SP - 959
EP - 970
JO - Cognitive Therapy and Research
JF - Cognitive Therapy and Research
IS - 6
ER -