scholarly journals A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics

2018 ◽  
Vol 5 (3) ◽  
pp. e50 ◽  
Author(s):  
Michael Jae Song ◽  
John Ward ◽  
Fiona Choi ◽  
Mohammadali Nikoo ◽  
Anastasia Frank ◽  
...  

Background Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. Objective The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. Methods Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. Results The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. Conclusions Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools.

2017 ◽  
Author(s):  
Michael Jae Song ◽  
John Ward ◽  
Fiona Choi ◽  
Mohammadali Nikoo ◽  
Anastasia Frank ◽  
...  

BACKGROUND Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. OBJECTIVE The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. METHODS Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. RESULTS The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. CONCLUSIONS Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools.


2019 ◽  
Author(s):  
Gustav Petersen ◽  
Jakob Hyldig Nielsen ◽  
Johannes Verner Olsen ◽  
Robin Niels Kok

Background: Even though problems with usability constitute a major challenge to the implementation of new eHealth technology, the field web-based interventions is lacking usability guidelines for development and evaluation of web-based intervention platforms. Objective: The aim of present study is to create a set of eHealth-specific usability guidelines for the development and evaluation of web-based mental health interventions. Methods: Knowledge about usability was gathered from peripheral fields of e-learning, emotional design, and human-computer interaction in a top-down approach. This knowledge was synthesized into usability guidelines for web-based interventions, which were then case-tested on an existing web-based intervention for patients with health anxiety, using the heuristic evaluation method. Results: Nine broad guidelines were developed. The subsequent case-test of the web-based intervention showed that application of the guidelines was feasible and was able to identify several important usability issues with the intervention. Conclusions: Health professionals should be included in intervention design. Future usability assessment should focus on the different usability attributes. The relationship between usability and adherence needs further investigation.


2017 ◽  
Vol 8 ◽  
Author(s):  
Derek de Beurs ◽  
Inge van Bruinessen ◽  
Janneke Noordman ◽  
Roland Friele ◽  
Sandra van Dulmen

2021 ◽  
Author(s):  
Dilan Hulaj ◽  
Sophie Antesberger ◽  
Tabea Blum ◽  
Raffaela Böswald ◽  
Hannah M. Brandl ◽  
...  

Importance: Although young adults are on average less affected by the physical consequences of COVID-19 infections, showing less severe disease progression and lower mortality risk, they suffer strongly from the mental health impact of the pandemic.Objective: We, a group of psychology students experiencing these impacts, aim to provide an overview of the existing literature on prevention and intervention efforts to effectively reduce the development of, or suffering from, mental health problems in young adults (18-35) during the COVID-19 pandemic.Evidence Review: A rapid systematic review was conducted to identify studies focusing on the implementation of mental health interventions for young adults of the general population during the COVID-19 pandemic. Literature was searched with Pubmed and Web of Science on June 17, 2021. The quality of each study was assessed by two reviewers with the Standard Quality Assessment Criteria for Evaluating Primary Research Papers.Findings: Of N = 76 records initially screened, eight studies met the inclusion criteria. Six applied web-based interventions, of which four were randomized controlled trials. Interventions were based on Cognitive Behavioral Therapy approaches (n = 5), mindfulness practices, logo-autobiography, and synergistic thinking methods. The interventions varied in length from single sessions to multiple sessions over a period of up to 10 weeks. All interventions were effective in reducing depression and anxiety symptoms, as well as stress with small to medium effect sizes and a symptom reduction up to 78.9%. With only three studies being of high quality, the overall quality was low.Conclusions and Relevance: Research on mental health interventions for young adults in the general population during the pandemic is sparse. However, all interventions resulted in symptoms reductions and thus have been shown to be effective ways of counteracting the potential development of mental disorders during times of uncertainty, with high levels of stress, such as during a pandemic. Therefore, we propose a concept for an innovative and cost-effective web-based platform to structure and raise awareness for existing measures.


2021 ◽  
Vol 12 ◽  
Author(s):  
Eliane M. Boucher ◽  
Haley E. Ward ◽  
Amelia C. Mounts ◽  
Acacia C. Parks

Digital mental health interventions (DMHI) are scalable and cost-effective strategies for increasing access to mental health care; however, dropout rates associated with digital interventions are high, particularly for open-access digital interventions. While some studies have focused on predictors of dropout from digital mental health programs, few studies have focused on engagement features that might improve engagement. In this perspective article, we discuss whether monetary incentives (MI) are one avenue to increasing user engagement in DMHI. We begin by reviewing the literature on the effects of MI for behavior change in health domains (e.g., dietary behaviors, substance use, and medication adherence). Then, drawing on a pilot study we conducted to test the effects of different levels of MI on usage and improvement in subjective well-being among users of a DMHI (Happify), we discuss the potential applications of MI for DMHI, the potential drawbacks of financial incentives in this context, and open questions for future research.


2021 ◽  
Author(s):  
Jessica Kemp ◽  
Jill Chorney ◽  
Iman Kassam ◽  
Julie MacDonald ◽  
Tara MacDonald ◽  
...  

BACKGROUND The coronavirus disease (COVID-19) pandemic has increased the demand for youth mental health services in Canada as disruptions to care continue to persist due to risk of transmission and exposure to the virus. Digital mental health interventions, including web-based resources and mobile apps, have provided opportunities to support youth mental health remotely across Canada. There is a need to better understand the ways in which these digital interventions are being selected, recommended, and used in various regions across Canada. OBJECTIVE A national jurisdictional scan was completed to 1) determine what online programs, apps and websites are promoted and/or licensed in Canada for youth mental health, 2) identify criteria and/or decision-making processes that Canadian jurisdictions use to select online programs, apps and websites for youth mental health, and 3) identify upcoming trends, innovations and digital mental health possibilities that are emerging in the youth sector. METHODS The aims of the jurisdictional scan were addressed through a review of related academic and grey literature, stakeholder interviews including individuals involved in various areas of the youth mental health sector, and a social media review of pertinent Twitter content. RESULTS A total of 66 web-based resources and apps were identified for use by youth in Canada. 16 stakeholder interviews were completed and included discussions with researchers, clinicians, youth organizations, and others involved in digital interventions for youth mental health. Over a 4-week period, 2,184 tweets were reviewed to identify global trends and innovations involving digital mental health and youth. CONCLUSIONS As organizations begin to plan for the delivery of mental healthcare post-pandemic, there are some concerns about the sustainability of these digital mental health interventions as well as need for services to be more informed by experiences and preferences of youth.


2021 ◽  
pp. 1-12
Author(s):  
Peter Musiat ◽  
Catherine Johnson ◽  
Melissa Atkinson ◽  
Simon Wilksch ◽  
Tracey Wade

Abstract Web-based interventions are increasingly used for the prevention, treatment and aftercare of mental disorders. A crucial factor to the efficacy of such online programmes is adherence to the intervention content and procedure. It has been frequently suggested that adherence in web-based interventions is low and little is known about which factors influence adherence. To increase intervention uptake and completion, studies increasingly include interventions with some form of guidance. Guided interventions have been shown to have higher efficacy, however, evidence for the impact on adherence is limited and mixed. This meta-analysis explored the impact of human guidance on intervention completion in web-based mental health interventions. A total of 22 studies were included with interventions primarily targeting symptoms of depression and anxiety disorders. Results showed that guidance significantly increases the average amount of intervention completion [g = 0.29, 95% confidence interval (CI) 0.18–0.40] and the proportion of intervention completers [log odds ratio (OR) = 0.50, 95% CI 0.34–0.66] with small effects. On average, full completion rates were 12% higher in guided intervention groups. This meta-analysis demonstrated that guidance in web-based mental health interventions does increase adherence, but more research is required to better understand the specific mechanisms between guidance, adherence and outcomes.


2019 ◽  
Vol 5 ◽  
pp. 205520761987806
Author(s):  
Philip J Batterham ◽  
Alison L Calear ◽  
Bridianne O’Dea ◽  
Mark E Larsen ◽  
David J Kavanagh ◽  
...  

Background Digital mental health interventions can be effective for treating mental health problems, but uptake by consumers and clinicians is not optimal. The lack of an accreditation pathway for digital mental health interventions is a barrier to their uptake among clinicians and consumers. However, there are a number of factors that may contribute to whether a digital intervention is suitable for recommendation to the public. The aim of this study was to identify the types of evidence that would support the accreditation of digital interventions. Method An expert workshop was convened, including researcher, clinician, consumer (people with lived experience of a mental health condition) and policymaker representatives. Results Existing methods for assessing the evidence for digital mental health interventions were discussed by the stakeholders present at the workshop. Empirical evidence from randomised controlled trials was identified as a key component for evaluating digital interventions. However, information on the safety of users, data security, user ratings, and fidelity to clinical guidelines, along with data from routine care including adherence, engagement and clinical outcomes, were also identified as important considerations when evaluating an intervention. There are considerable challenges in weighing the evidence for a digital mental health intervention. Conclusions Empirical evidence should be the cornerstone of any accreditation system to identify appropriate digital mental health interventions. However, robust accreditation systems should also account for program and user safety, user engagement and experience, and fidelity to clinical treatment guidelines.


Author(s):  
Christopher R Shelton ◽  
Anitgoni Kotsiou ◽  
Melanie D. Hetzel-Riggin

This chapter will provide a brief background on the need for digital mental health interventions given the high rates of mental health issues and the barriers to access quality care. Three main types of digital mental health interventions (internet-based interventions [IBIs], smartphone apps, and virtual and augmented reality [VR and AR, respectively]) will be discussed, followed by a consideration of the ethical and logistical issues surrounding digital mental health interventions. The chapter will then address issues related to content and design, user engagement, user contact, and formatting of the interventions. Finally, the chapter will end with a discussion of future directions.


Sign in / Sign up

Export Citation Format

Share Document