Psychometric validation of a pre-existing questionnaire used to measure patient satisfaction following orthodontic treatment in a UK population

Katy Tidbury; Mark Sayers; Manoharan Andiappan; Jonathon T. Newton

doi:10.1177/1465312520985520

Psychometric validation of a pre-existing questionnaire used to measure patient satisfaction following orthodontic treatment in a UK population

Katy Tidbury^*, Mark Sayers, Manoharan Andiappan, Jonathon T. Newton

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

1 Citation (Scopus)

Abstract

Objective: To determine the psychometric properties of a pre-existing orthodontic satisfaction questionnaire and to assess patient satisfaction of their orthodontic treatment. Design: Psychometric assessment of a pre-existing orthodontic satisfaction questionnaire. Setting: Two sites at King’s College Hospital NHS Foundation Trust. Participants: Individuals aged 12–15 years who had completed fixed orthodontic treatment. Methods: An expert panel assessed a pre-existing orthodontic treatment satisfaction questionnaire for validity and readability. As a result, revisions were made to the questionnaire and it was distributed to 103 participants aged 12–15 years, on completion of their fixed orthodontic treatment (T1). Test–retest reliability of the questionnaire was assessed through completion of a second questionnaire by 17 participants, at a two-week interval (T2). The questionnaire was assessed for reliability using item-total correlations (I-TC) and Cronbach’s alpha. Factor analysis allowed exploration of the underlying factor structure of the questionnaire. Test–retest reliability was assessed using Cohen’s kappa coefficient. Multiple regression analysis was used to find out the significant demographic variables that predicts the satisfaction level of treatment. Results: Following validity and readability assessment by the expert panel, the questionnaire was revised. Eleven items were removed following item analysis (with I-TC ⩽ 0.3). Factor analysis was deemed uninterpretable. The overall scale demonstrated greater reliability than the underlying sub-scales. Therefore, the sub-scales were removed, resulting in one scale which assessed overall orthodontic satisfaction, comprising 37 items, with a Cronbach alpha of 0.92. The test–retest reliability of the revised 37-item scale was deemed to be poor (kappa coefficient = 0.39). Multiple regression analysis identified ethnicity as a significant predictor of orthodontic treatment satisfaction (P = 0.01). Conclusion: This study provides a valid measure to assess orthodontic treatment satisfaction for use in a UK population aged 12–15 years on completion of fixed orthodontic treatment.

Original language	English
Pages (from-to)	231-240
Number of pages	10
Journal	Journal of orthodontics
Volume	48
Issue number	3
DOIs	https://doi.org/10.1177/1465312520985520
Publication status	Published - Sept 2021

Keywords

patient satisfaction
psychometric validation
satisfaction questionnaire

Access to Document

10.1177/1465312520985520

Cite this

@article{f307b93dc56c4504b67599bd37fe4f96,

title = "Psychometric validation of a pre-existing questionnaire used to measure patient satisfaction following orthodontic treatment in a UK population",

abstract = "Objective: To determine the psychometric properties of a pre-existing orthodontic satisfaction questionnaire and to assess patient satisfaction of their orthodontic treatment. Design: Psychometric assessment of a pre-existing orthodontic satisfaction questionnaire. Setting: Two sites at King{\textquoteright}s College Hospital NHS Foundation Trust. Participants: Individuals aged 12–15 years who had completed fixed orthodontic treatment. Methods: An expert panel assessed a pre-existing orthodontic treatment satisfaction questionnaire for validity and readability. As a result, revisions were made to the questionnaire and it was distributed to 103 participants aged 12–15 years, on completion of their fixed orthodontic treatment (T1). Test–retest reliability of the questionnaire was assessed through completion of a second questionnaire by 17 participants, at a two-week interval (T2). The questionnaire was assessed for reliability using item-total correlations (I-TC) and Cronbach{\textquoteright}s alpha. Factor analysis allowed exploration of the underlying factor structure of the questionnaire. Test–retest reliability was assessed using Cohen{\textquoteright}s kappa coefficient. Multiple regression analysis was used to find out the significant demographic variables that predicts the satisfaction level of treatment. Results: Following validity and readability assessment by the expert panel, the questionnaire was revised. Eleven items were removed following item analysis (with I-TC ⩽ 0.3). Factor analysis was deemed uninterpretable. The overall scale demonstrated greater reliability than the underlying sub-scales. Therefore, the sub-scales were removed, resulting in one scale which assessed overall orthodontic satisfaction, comprising 37 items, with a Cronbach alpha of 0.92. The test–retest reliability of the revised 37-item scale was deemed to be poor (kappa coefficient = 0.39). Multiple regression analysis identified ethnicity as a significant predictor of orthodontic treatment satisfaction (P = 0.01). Conclusion: This study provides a valid measure to assess orthodontic treatment satisfaction for use in a UK population aged 12–15 years on completion of fixed orthodontic treatment.",

keywords = "patient satisfaction, psychometric validation, satisfaction questionnaire",

author = "Katy Tidbury and Mark Sayers and Manoharan Andiappan and Newton, {Jonathon T.}",

note = "Funding Information: The authors thank the orthodontists and clinical psychologists who took part in this study and to the participants for their time in completing the questionnaires. The author(s) received no financial support for the research, authorship, and/or publication of this article. Publisher Copyright: {\textcopyright} The Author(s) 2021.",

year = "2021",

month = sep,

doi = "10.1177/1465312520985520",

language = "English",

volume = "48",

pages = "231--240",

journal = "Journal of orthodontics",

issn = "1465-3125",

publisher = "Sage Publications",

number = "3",

}

TY - JOUR

T1 - Psychometric validation of a pre-existing questionnaire used to measure patient satisfaction following orthodontic treatment in a UK population

AU - Tidbury, Katy

AU - Sayers, Mark

AU - Andiappan, Manoharan

AU - Newton, Jonathon T.

N1 - Funding Information: The authors thank the orthodontists and clinical psychologists who took part in this study and to the participants for their time in completing the questionnaires. The author(s) received no financial support for the research, authorship, and/or publication of this article. Publisher Copyright: © The Author(s) 2021.

PY - 2021/9

Y1 - 2021/9

N2 - Objective: To determine the psychometric properties of a pre-existing orthodontic satisfaction questionnaire and to assess patient satisfaction of their orthodontic treatment. Design: Psychometric assessment of a pre-existing orthodontic satisfaction questionnaire. Setting: Two sites at King’s College Hospital NHS Foundation Trust. Participants: Individuals aged 12–15 years who had completed fixed orthodontic treatment. Methods: An expert panel assessed a pre-existing orthodontic treatment satisfaction questionnaire for validity and readability. As a result, revisions were made to the questionnaire and it was distributed to 103 participants aged 12–15 years, on completion of their fixed orthodontic treatment (T1). Test–retest reliability of the questionnaire was assessed through completion of a second questionnaire by 17 participants, at a two-week interval (T2). The questionnaire was assessed for reliability using item-total correlations (I-TC) and Cronbach’s alpha. Factor analysis allowed exploration of the underlying factor structure of the questionnaire. Test–retest reliability was assessed using Cohen’s kappa coefficient. Multiple regression analysis was used to find out the significant demographic variables that predicts the satisfaction level of treatment. Results: Following validity and readability assessment by the expert panel, the questionnaire was revised. Eleven items were removed following item analysis (with I-TC ⩽ 0.3). Factor analysis was deemed uninterpretable. The overall scale demonstrated greater reliability than the underlying sub-scales. Therefore, the sub-scales were removed, resulting in one scale which assessed overall orthodontic satisfaction, comprising 37 items, with a Cronbach alpha of 0.92. The test–retest reliability of the revised 37-item scale was deemed to be poor (kappa coefficient = 0.39). Multiple regression analysis identified ethnicity as a significant predictor of orthodontic treatment satisfaction (P = 0.01). Conclusion: This study provides a valid measure to assess orthodontic treatment satisfaction for use in a UK population aged 12–15 years on completion of fixed orthodontic treatment.

AB - Objective: To determine the psychometric properties of a pre-existing orthodontic satisfaction questionnaire and to assess patient satisfaction of their orthodontic treatment. Design: Psychometric assessment of a pre-existing orthodontic satisfaction questionnaire. Setting: Two sites at King’s College Hospital NHS Foundation Trust. Participants: Individuals aged 12–15 years who had completed fixed orthodontic treatment. Methods: An expert panel assessed a pre-existing orthodontic treatment satisfaction questionnaire for validity and readability. As a result, revisions were made to the questionnaire and it was distributed to 103 participants aged 12–15 years, on completion of their fixed orthodontic treatment (T1). Test–retest reliability of the questionnaire was assessed through completion of a second questionnaire by 17 participants, at a two-week interval (T2). The questionnaire was assessed for reliability using item-total correlations (I-TC) and Cronbach’s alpha. Factor analysis allowed exploration of the underlying factor structure of the questionnaire. Test–retest reliability was assessed using Cohen’s kappa coefficient. Multiple regression analysis was used to find out the significant demographic variables that predicts the satisfaction level of treatment. Results: Following validity and readability assessment by the expert panel, the questionnaire was revised. Eleven items were removed following item analysis (with I-TC ⩽ 0.3). Factor analysis was deemed uninterpretable. The overall scale demonstrated greater reliability than the underlying sub-scales. Therefore, the sub-scales were removed, resulting in one scale which assessed overall orthodontic satisfaction, comprising 37 items, with a Cronbach alpha of 0.92. The test–retest reliability of the revised 37-item scale was deemed to be poor (kappa coefficient = 0.39). Multiple regression analysis identified ethnicity as a significant predictor of orthodontic treatment satisfaction (P = 0.01). Conclusion: This study provides a valid measure to assess orthodontic treatment satisfaction for use in a UK population aged 12–15 years on completion of fixed orthodontic treatment.

KW - patient satisfaction

KW - psychometric validation

KW - satisfaction questionnaire

UR - http://www.scopus.com/inward/record.url?scp=85113378067&partnerID=8YFLogxK

U2 - 10.1177/1465312520985520

DO - 10.1177/1465312520985520

M3 - Article

C2 - 33557661

AN - SCOPUS:85113378067

SN - 1465-3125

VL - 48

SP - 231

EP - 240

JO - Journal of orthodontics

JF - Journal of orthodontics

IS - 3

ER -

Psychometric validation of a pre-existing questionnaire used to measure patient satisfaction following orthodontic treatment in a UK population

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this