TY - JOUR
T1 - Feasibility of a mobile health app for routine outcome monitoring and feedback in SMART recovery mutual support groups
T2 - Stage 1 mixed methods pilot study
AU - Kelly, Peter J.
AU - Beck, Alison K.
AU - Deane, Frank P.
AU - Larance, Briony
AU - Baker, Amanda L.
AU - Hides, Leanne
AU - Manning, Victoria
AU - Shakeshaft, Anthony
AU - Neale, Joanne
AU - Kelly, John F.
AU - Oldmeadow, Christopher
AU - Searles, Andrew
AU - Palazzi, Kerrin
AU - Lawson, Kenny
AU - Treloar, Carla
AU - Gray, Rebecca M.
AU - Argent, Angela
AU - McGlaughlin, Ryan
N1 - Funding Information:
Funding for this research was provided by the New South Wales Ministry of Health under the New South Wales Health Alcohol and Other Drugs Early Intervention Innovation Grant Scheme. The funding body did not directly contribute to the design, conduct, analysis, write-up, and submission of this research for publication and does not have the ultimate authority over any of these activities.
Publisher Copyright:
© Peter J Kelly, Alison K Beck, Frank P Deane, Briony Larance, Amanda L Baker, Leanne Hides, Victoria Manning, Anthony Shakeshaft, Joanne Neale, John F Kelly, Christopher Oldmeadow, Andrew Searles, Kerrin Palazzi, Kenny Lawson, Carla Treloar, Rebecca M Gray, Angela Argent, Ryan McGlaughlin.
PY - 2021/10
Y1 - 2021/10
N2 - Background: Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM. Objective: The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks. Methods: SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8). Results: Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8-week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI –2.02 to 2.24) was reported. Conclusions: Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups.
AB - Background: Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM. Objective: The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks. Methods: SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8). Results: Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8-week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI –2.02 to 2.24) was reported. Conclusions: Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups.
KW - Addiction
KW - MHealth
KW - Mobile phone
KW - Mutual aid
KW - Mutual support group
KW - Routine outcome monitoring
KW - SMART recovery
KW - Treatment progress feedback
UR - http://www.scopus.com/inward/record.url?scp=85117226751&partnerID=8YFLogxK
U2 - 10.2196/25217
DO - 10.2196/25217
M3 - Article
AN - SCOPUS:85117226751
SN - 1438-8871
VL - 23
JO - Journal of Medical Internet Research
JF - Journal of Medical Internet Research
IS - 10
M1 - e25217
ER -