scholarly journals The effectiveness of nudging: A meta-analysis of choice architecture interventions across behavioral domains

2022 ◽  
Vol 119 (1) ◽  
pp. e2107346118
Author(s):  
Stephanie Mertens ◽  
Mario Herberz ◽  
Ulf J. J. Hahnel ◽  
Tobias Brosch

Over the past decade, choice architecture interventions or so-called nudges have received widespread attention from both researchers and policy makers. Built on insights from the behavioral sciences, this class of behavioral interventions focuses on the design of choice environments that facilitate personally and socially desirable decisions without restricting people in their freedom of choice. Drawing on more than 200 studies reporting over 450 effect sizes (n = 2,149,683), we present a comprehensive analysis of the effectiveness of choice architecture interventions across techniques, behavioral domains, and contextual study characteristics. Our results show that choice architecture interventions overall promote behavior change with a small to medium effect size of Cohen’s d = 0.45 (95% CI [0.39, 0.52]). In addition, we find that the effectiveness of choice architecture interventions varies significantly as a function of technique and domain. Across behavioral domains, interventions that target the organization and structure of choice alternatives (decision structure) consistently outperform interventions that focus on the description of alternatives (decision information) or the reinforcement of behavioral intentions (decision assistance). Food choices are particularly responsive to choice architecture interventions, with effect sizes up to 2.5 times larger than those in other behavioral domains. Overall, choice architecture interventions affect behavior relatively independently of contextual study characteristics such as the geographical location or the target population of the intervention. Our analysis further reveals a moderate publication bias toward positive results in the literature. We end with a discussion of the implications of our findings for theory and behaviorally informed policy making.

2008 ◽  
Vol 31 (2) ◽  
pp. 111-135 ◽  
Author(s):  
H. Lee Gillis ◽  
Elizabeth Speelman

This study reports the results of a meta-analysis of 44 studies that examined the impacts of participation in challenge (ropes) course activities. Overall, a medium standardized mean difference effect size was found (d = 0.43). Effect sizes were calculated for various study characteristics, including demographics and outcome. Higher effects were found for adult groups (d = 0.80) and for studies measuring family functioning (d = 0.67). Studies with therapeutic (d = 0.53) or developmental foci (d = 0.47) had higher effect sizes than those with educational foci (d = 0.17). Higher effect sizes for group effectiveness (d = 0.62) affirmed the use of challenge course experiences for team-building purposes. Implications for further research include the importance of recording detailed program design information, selecting appropriate instrumentation, and including follow-up data.


2020 ◽  
Vol 25 (5) ◽  
pp. 461-479
Author(s):  
Hadjira Bendella ◽  
Hans-Georg Wolff

PurposeNetworking refers to goal-directed behaviors focused on building and cultivating informal relationships to obtain career-related resources. According to Gibson et al.'s (2014) model, personality traits represent prominent and important antecedents of networking. This study seeks to provide robust evidence on relationships between personality and networking by summarizing prior research using meta-analytical tools.Design/methodology/approachThe authors classify linking attributes between networking and personality into social, idea-related, task-related and affective behavioral domains and additionally include three compound traits that relate to several domains. They investigate two potential moderators: internal vs. external networking and prominent networking measures. Their comprehensive literature search identified 41 studies with 46 independent samples.FindingsThe authors find that social, idea-related and task-related traits have positive relationships with networking of medium effect size, whereas affective traits exhibit small but significantly positive effects. The compound trait of proactive personality appears to be the best predictor of networking. Moderator analyses indicate that there were hardly any differences concerning internal and external networking and also prominent measures.Originality/valueThe present study goes beyond narrative reviews contributing the first quantitative summary of these relationships. It identifies four behavioral domains that represent characteristics relevant to networking. The findings largely corroborate, but at times correct, narrative reviews on dispositional antecedents of networking. The authors highlight the importance of compound traits that have yet been overlooked by narrative reviews (e.g. self-monitoring).


2012 ◽  
Vol 2012 ◽  
pp. 1-8 ◽  
Author(s):  
Yongliang Jia ◽  
Cong Chen ◽  
Choi-San Ng ◽  
Siu-Wai Leung

Objective. Randomized controlled trials (RCTs) on di’ao xinxuekang capsule (XXK) in treating angina pectoris were published only in Chinese and have not been systematically reviewed particularly for comparing XXK with isosorbide dinitrate (ISDN). This study aims to provide a comprehensive PRISMA compliant and internationally accessible systematic review and meta-analysis to evaluate the efficacies of XXK and ISDN in treating angina pectoris.Methods. The RCTs published between 1989 and 2011 on XXK and ISDN in treating angina pectoris were selected according to specific criteria. Meta-analysis was performed to evaluate the symptomatic (SYMPTOMS) and electrocardiographic (ECG) improvements after treatment. Odds ratios (OR) were used to measure effect sizes. Subgroup analysis, sensitivity analysis, and metaregression were conducted to evaluate the robustness of the results.Results. Seven RCTs with 550 participants were eligible. Overall ORs for comparing XXK with ISDN were 4.11 (95% CI :  2.57, 6.55) in SYMPTOMS and 2.37 (95% CI : 1.46, 3.84) in ECG. Subgroup analysis, sensitivity analysis, and metaregression found no significant dependence of overall ORs upon specific study characteristics.Conclusion. The meta-analysis of eligible but limited RCTs demonstrates that XXK seems to be more effective than ISDN in treating angina pectoris. Further RCTs of high quality are warranted to be conducted for update of the results of this meta-analysis.


2020 ◽  
Author(s):  
Michael W. Beets ◽  
R. Glenn Weaver ◽  
John P.A. Ioannidis ◽  
Alexis Jones ◽  
Lauren von Klinggraeff ◽  
...  

Abstract Background: Pilot/feasibility or studies with small sample sizes may be associated with inflated effects. This study explores the vibration of effect sizes (VoE) in meta-analyses when considering different inclusion criteria based upon sample size or pilot/feasibility status. Methods: Searches were conducted for meta-analyses of behavioral interventions on topics related to the prevention/treatment of childhood obesity from 01-2016 to 10-2019. The computed summary effect sizes (ES) were extracted from each meta-analysis. Individual studies included in the meta-analyses were classified into one of the following four categories: self-identified pilot/feasibility studies or based upon sample size (N≤100, N>100, and N>370 the upper 75th of sample size). The VoE was defined as the absolute difference (ABS) between the re-estimations of summary ES restricted to study classifications compared to the originally reported summary ES. Concordance (kappa) of statistical significance between summary ES was assessed. Fixed and random effects models and meta-regressions were estimated. Three case studies are presented to illustrate the impact of including pilot/feasibility and N≤100 studies on the estimated summary ES.Results: A total of 1,602 effect sizes, representing 145 reported summary ES, were extracted from 48 meta-analyses containing 603 unique studies (avg. 22 avg. meta-analysis, range 2-108) and included 227,217 participants. Pilot/feasibility and N≤100 studies comprised 22% (0-58%) and 21% (0-83%) of studies. Meta-regression indicated the ABS between the re-estimated and original summary ES where summary ES were comprised of ≥40% of N≤100 studies was 0.29. The ABS ES was 0.46 when summary ES comprised of >80% of both pilot/feasibility and N≤100 studies. Where ≤40% of the studies comprising a summary ES had N>370, the ABS ES ranged from 0.20-0.30. Concordance was low when removing both pilot/feasibility and N≤100 studies (kappa=0.53) and restricting analyses only to the largest studies (N>370, kappa=0.35), with 20% and 26% of the originally reported statistically significant ES rendered non-significant. Reanalysis of the three case study meta-analyses resulted in the re-estimated ES rendered either non-significant or half of the originally reported ES. Conclusions: When meta-analyses of behavioral interventions include a substantial proportion of both pilot/feasibility and N≤100 studies, summary ES can be affected markedly and should be interpreted with caution.


2019 ◽  
pp. 152483801988173
Author(s):  
Elisa Romano ◽  
Kelly Weegar ◽  
Elena Gallitto ◽  
Sarah Zak ◽  
Michael Saini

Several reviews have been conducted on children’s outcomes following exposure to intimate partner violence (IPV), but there remain inconsistent findings. We conducted a meta-analysis on child emotional and behavioral outcomes of IPV exposure interventions, based on published reviews that included a child component. We also explored relative effect sizes by examining moderators of the effect sizes across studies. This meta-analysis included 21 evaluation studies across 12 published reviews, which were located using a multiple database systematic search of English publications between 2000 and 2019. Studies were required to evaluate IPV interventions that included children, to gather quantitative pre- and post-intervention data on child outcomes, to use standardized instruments, and to present data in a format that could be used in a meta-analysis. Results indicated an overall pre- to post-intervention medium effect size ( d = 0.49), with effect sizes ranging from small to large depending on the specific outcome. Improvements at follow-up were maintained for internalizing behaviors but decreased for trauma-related symptoms and social, externalizing, and total behaviors. However, externalizing and total behavior outcomes still had significant effect sizes in the small-to-medium range ( d = 0.36 and 0.44). There were greater intervention effects when treatment was not exclusively trauma-specific. It appears that IPV exposure interventions are generally effective for improving children’s emotional and behavioral well-being, although interventions would benefit from greater tailoring to children’s specific needs. Interventions may also benefit from incorporating various content areas (both trauma-specific and non-trauma-specific) and from greater focus on ensuring the maintenance of treatment gains.


2021 ◽  
Vol 36 (6) ◽  
pp. 1096-1096
Author(s):  
Natasha Nemanim ◽  
Nicholas Lackey ◽  
Eric J Connors ◽  
Alexander O Hauson ◽  
Anna Pollard ◽  
...  

Abstract Objective A previous meta-analysis assessing the impact of heart failure (HF) on cognition found the HF group performed more poorly than the healthy control (HC) on global cognition measures. The study observed a medium effect and moderate heterogeneity when using the Mini-Mental Status Examination (MMSE) to measure HF’s impact on global cognition. The current meta-regression explores whether the mean age of the HF group moderates performance on the MMSE when comparing HF patients to HC. Data Selection Two researchers independently searched eight databases, extracted data, and calculated effect sizes as part of a larger study. Inclusion criteria were: (a) adults with a diagnosis of HF, (b) comparison of HF patients to HC, and (c) adequate data to calculate effect sizes. Articles were excluded if patients had other types of organ failure, the article was not available in English, or there was a risk of sample overlap with another included study. Twelve articles (HF n = 1166 and HC n = 1948) were included. The unrestricted maximum likelihood computational model was used for the meta-regression. Data Synthesis Studies included in the meta-regression evidenced a statistically significant medium effect size estimate with moderate heterogeneity (k = 12, g = 0.671, p < 0.001, I2 = 80.91%). The meta-regression was statistically significant (slope = −0.023, p = 0.0022, Qmodel = 5.26, df = 1, p = 0.022). Conclusions Individuals with HF performed more poorly on the MMSE than HC. Larger effect sizes on the MMSE were observed in studies with participants who were younger compared to studies with participants who were older. Future research should continue to delineate the impact of age on global cognition in individuals with HF.


2020 ◽  
Vol 46 (4) ◽  
pp. 869-883 ◽  
Author(s):  
Kelly Allott ◽  
Kristi van-der-EL ◽  
Shayden Bryce ◽  
Emma M Parrish ◽  
Susan R McGurk ◽  
...  

Abstract Objective Cognitive compensatory interventions aim to alleviate psychosocial disability by targeting functioning directly using aids and strategies, thereby minimizing the impact of cognitive impairment. The aim was to conduct a systematic review and meta-analysis of cognitive compensatory interventions for psychosis by examining the effects on functioning and symptoms, and exploring whether intervention factors, study design, and age influenced effect sizes. Methods Electronic databases (Ovid Medline, PsychINFO) were searched up to October 2018. Records obtained through electronic and manual searches were screened independently by two reviewers according to selection criteria. Data were extracted to calculate estimated effects (Hedge’s g) of treatment on functioning and symptoms at post-intervention and follow-up. Study quality was assessed using Cochrane Collaboration’s risk of bias tool. Results Twenty-six studies, from 25 independent randomized controlled trials (RCTs) were included in the meta-analysis (1654 participants, mean age = 38.9 years, 64% male). Meta-analysis revealed a medium effect of compensatory interventions on functioning compared to control conditions (Hedge’s g = 0.46, 95% CI = 0.33, 0.60, P < .001), with evidence of relative durability at follow-up (Hedge’s g = 0.36, 95% CI = 0.19, 0.54, P < .001). Analysis also revealed small significant effects of cognitive compensatory treatment on negative, positive, and general psychiatric symptoms, but not depressive symptoms. Estimated effects did not significantly vary according to treatment factors (ie, compensatory approach, dosage), delivery method (ie, individual/group), age, or risk of bias. Longer treatment length was associated with larger effect sizes for functioning outcomes. No evidence of publication bias was identified. Conclusion Cognitive compensatory interventions are associated with robust, durable improvements in functioning in people with psychotic illnesses.


1995 ◽  
Vol 65 (4) ◽  
pp. 509-514 ◽  
Author(s):  
Sandra Graham

Some of the benefits and shortcomings of a meta-analytic approach to reviewing race differences in need for achievement ( Cooper & Dorr, 1995 ) are examined and compared to the narrative approach that I adopted in a previous review on this topic ( Graham, 1994 ). Among the benefits of meta-analysis are the calculation of effect sizes for race differences (compared to the box score method of my narrative review) and the presentation of replicable and objective procedures for organizing, describing, and comparing study characteristics. Among the perceived limitations are the meta-analyst’s reluctance to distinguish between low- and high-quality studies and an overemphasis on quantitative comparisons of substantively disparate literatures. The implications for studying race as a psychological variable are also discussed.


Author(s):  
Alexis Jones ◽  
Bridget Armstrong ◽  
R. Glenn Weaver ◽  
Hannah Parker ◽  
Lauren von Klinggraeff ◽  
...  

Abstract Background Excessive screen time ($$\ge$$ ≥ 2 h per day) is associated with childhood overweight and obesity, physical inactivity, increased sedentary time, unfavorable dietary behaviors, and disrupted sleep. Previous reviews suggest intervening on screen time is associated with reductions in screen time and improvements in other obesogenic behaviors. However, it is unclear what study characteristics and behavior change techniques are potential mechanisms underlying the effectiveness of behavioral interventions. The purpose of this meta-analysis was to identify the behavior change techniques and study characteristics associated with effectiveness in behavioral interventions to reduce children’s (0–18 years) screen time. Methods A literature search of four databases (Ebscohost, Web of Science, EMBASE, and PubMed) was executed between January and February 2020 and updated during July 2021. Behavioral interventions targeting reductions in children’s (0–18 years) screen time were included. Information on study characteristics (e.g., sample size, duration) and behavior change techniques (e.g., information, goal-setting) were extracted. Data on randomization, allocation concealment, and blinding was extracted and used to assess risk of bias. Meta-regressions were used to explore whether intervention effectiveness was associated with the presence of behavior change techniques and study characteristics. Results The search identified 15,529 articles, of which 10,714 were screened for relevancy and 680 were retained for full-text screening. Of these, 204 studies provided quantitative data in the meta-analysis. The overall summary of random effects showed a small, beneficial impact of screen time interventions compared to controls (SDM = 0.116, 95CI 0.08 to 0.15). Inclusion of the Goals, Feedback, and Planning behavioral techniques were associated with a positive impact on intervention effectiveness (SDM = 0.145, 95CI 0.11 to 0.18). Interventions with smaller sample sizes (n < 95) delivered over short durations (< 52 weeks) were associated with larger effects compared to studies with larger sample sizes delivered over longer durations. In the presence of the Goals, Feedback, and Planning behavioral techniques, intervention effectiveness diminished as sample size increased. Conclusions Both intervention content and context are important to consider when designing interventions to reduce children’s screen time. As interventions are scaled, determining the active ingredients to optimize interventions along the translational continuum will be crucial to maximize reductions in children’s screen time.


2019 ◽  
Author(s):  
Thomas Lieber

abstractResearch on Targeted Memory Reactivation (TMR) shows that it’s a successful for increasing memory recall. However, As of yet no systematic study had been conducted to evaluate to what extend TMR can increase recall. This study used a comprehensive literature search to attempt to find all studies conducted in which TMR is used to increase memory recall. Methodological quality, study characteristics and where possible descriptive statistics were extracted from the studies. In total, 41 studies were identified, 26 of which included enough descriptive data to be included in the meta-analysis. The results indicated that the average methodological quality was good. Furthermore, TMR significantly increased memory recall. The subgroup analysis for modality was not significant, while the subgroup analysis for type of memory did yield a significant result. Overall, TMR seems to have small to medium effect on memory recall, is independent of modality and depends on memory.


Sign in / Sign up

Export Citation Format

Share Document