Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool

L. Hull; C. Bicknell; K. Patel; R. Vyas; I. Van Herzeele; N. Sevdalis; N. Rudarakanchana

doi:10.1016/j.ejvs.2015.12.044

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool

L. Hull, C. Bicknell, K. Patel, R. Vyas, I. Van Herzeele, N. Sevdalis, N. Rudarakanchana

Health Service & Population Research

Research output: Contribution to journal › Article › peer-review

15 Citations (Scopus)

191 Downloads (Pure)

Abstract

Objective/Background To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. Methods A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. Results OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Conclusion Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures.

Original language	English
Journal	European Journal of Vascular and Endovascular Surgery
Early online date	25 May 2016
DOIs	https://doi.org/10.1016/j.ejvs.2015.12.044
Publication status	E-pub ahead of print - 25 May 2016

Keywords

Assessment
Endovascular surgery
Evaluation
Team performance
Teamwork

Access to Document

10.1016/j.ejvs.2015.12.044

Content Validation and Evaluation_HULL_Publishedonline25May2016_GOLD VoR (CC BY-NC-ND)Final published version, 1.02 MBLicence: CC BY-NC-ND

Cite this

@article{4df132052cea4d0f88739e433e4939a9,

title = "Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool",

abstract = "Objective/Background To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. Methods A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. Results OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Conclusion Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures.",

keywords = "Assessment, Endovascular surgery, Evaluation, Team performance, Teamwork",

author = "L. Hull and C. Bicknell and K. Patel and R. Vyas and {Van Herzeele}, I. and N. Sevdalis and N. Rudarakanchana",

year = "2016",

month = may,

day = "25",

doi = "10.1016/j.ejvs.2015.12.044",

language = "English",

journal = "European Journal of Vascular and Endovascular Surgery",

issn = "1078-5884",

publisher = "Elsevier",

}

TY - JOUR

T1 - Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool

AU - Hull, L.

AU - Bicknell, C.

AU - Patel, K.

AU - Vyas, R.

AU - Van Herzeele, I.

AU - Sevdalis, N.

AU - Rudarakanchana, N.

PY - 2016/5/25

Y1 - 2016/5/25

N2 - Objective/Background To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. Methods A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. Results OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Conclusion Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures.

AB - Objective/Background To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. Methods A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. Results OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Conclusion Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures.

KW - Assessment

KW - Endovascular surgery

KW - Evaluation

KW - Team performance

KW - Teamwork

U2 - 10.1016/j.ejvs.2015.12.044

DO - 10.1016/j.ejvs.2015.12.044

M3 - Article

SN - 1078-5884

JO - European Journal of Vascular and Endovascular Surgery

JF - European Journal of Vascular and Endovascular Surgery

ER -

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool

Abstract

Keywords

Access to Document

Fingerprint

Cite this