TY - JOUR
T1 - Measuring how well the NHS looks after its own staff: methodology of the first national clinical audits of occupational health services in the NHS
AU - Williams, Sian
AU - Rogers, Caroline
AU - Peel, Penny
AU - Harvey, Samuel B.
AU - Henderson, Max
AU - Madan, Ira
AU - Smedley, Julia
AU - Grant, Robert
PY - 2012/4
Y1 - 2012/4
N2 - Rationale, aims and objectives: Little is known about the quality of occupational health care provided to National Health Service (NHS) staff. We designed the first national clinical audits of occupational health care in England. We chose to audit depression and back pain as health care workers have high levels of both conditions compared with other employment sectors. The aim of the audits was to drive up quality of care for staff with these conditions. The object of this paper is to describe how we developed an audit methodology and overcame challenges presented by the organization and delivery of occupational health care for NHS staff. Methods: We designed two retrospective case note audits which ran simultaneously. Sites submitted up to 40 cases for each audit. We used duplicate case entry to test inter-rater reliability and performed selection bias checks. Participants received their site's audit results, benchmarked against the national average, within 4 months of the end of the data entry period. We used electronic voting at a results dissemination conference to inform implementation activities. Results: Occupational Health departments providing services to 278 (83%) trusts in England participated in one or both audits. Median kappa scores were above 0.7 for both pilot and full audits, indicating ` good' levels of inter-rater reliability. In total, 79% of participants at a dissemination conference said that they had changed their clinical practice either during data collection (52%) or following receipt of their audit results (27%). Conclusions: Clinical audit can be conducted successfully in the occupational health setting. We obtained meaningful data that have stimulated local and national quality improvement activities. Our methodology would be transferable to occupational health settings outside the NHS and in other countries.
AB - Rationale, aims and objectives: Little is known about the quality of occupational health care provided to National Health Service (NHS) staff. We designed the first national clinical audits of occupational health care in England. We chose to audit depression and back pain as health care workers have high levels of both conditions compared with other employment sectors. The aim of the audits was to drive up quality of care for staff with these conditions. The object of this paper is to describe how we developed an audit methodology and overcame challenges presented by the organization and delivery of occupational health care for NHS staff. Methods: We designed two retrospective case note audits which ran simultaneously. Sites submitted up to 40 cases for each audit. We used duplicate case entry to test inter-rater reliability and performed selection bias checks. Participants received their site's audit results, benchmarked against the national average, within 4 months of the end of the data entry period. We used electronic voting at a results dissemination conference to inform implementation activities. Results: Occupational Health departments providing services to 278 (83%) trusts in England participated in one or both audits. Median kappa scores were above 0.7 for both pilot and full audits, indicating ` good' levels of inter-rater reliability. In total, 79% of participants at a dissemination conference said that they had changed their clinical practice either during data collection (52%) or following receipt of their audit results (27%). Conclusions: Clinical audit can be conducted successfully in the occupational health setting. We obtained meaningful data that have stimulated local and national quality improvement activities. Our methodology would be transferable to occupational health settings outside the NHS and in other countries.
U2 - 10.1111/j.1365-2753.2010.01574.x
DO - 10.1111/j.1365-2753.2010.01574.x
M3 - Article
VL - 18
SP - 283
EP - 289
JO - Journal of Evaluation in Clinical Practice
JF - Journal of Evaluation in Clinical Practice
IS - 2
ER -