Narrative Versus Meta-Analytic Reviews of Race Differences in Motivation: A Comment on Cooper and Dorr

1995 ◽  
Vol 65 (4) ◽  
pp. 509-514 ◽  
Author(s):  
Sandra Graham
Keyword(s):  
Meta Analysis ◽  
Race Differences ◽  
Analytic Approach ◽  
Effect Sizes ◽  
Narrative Approach ◽  
Need For Achievement ◽  
Psychological Variable ◽  
High Quality ◽  
Study Characteristics ◽  
Score Method

Some of the benefits and shortcomings of a meta-analytic approach to reviewing race differences in need for achievement ( Cooper & Dorr, 1995 ) are examined and compared to the narrative approach that I adopted in a previous review on this topic ( Graham, 1994 ). Among the benefits of meta-analysis are the calculation of effect sizes for race differences (compared to the box score method of my narrative review) and the presentation of replicable and objective procedures for organizing, describing, and comparing study characteristics. Among the perceived limitations are the meta-analyst’s reluctance to distinguish between low- and high-quality studies and an overemphasis on quantitative comparisons of substantively disparate literatures. The implications for studying race as a psychological variable are also discussed.

scholarly journals Disentangling ADHD's Presentation-Related Decision-Making—A Meta-Analytic Approach on Predominant Presentations

2021 ◽  
Vol 12 ◽  
Author(s):  
Marcel Schulze ◽  
David Coghill ◽  
Silke Lux ◽  
Alexandra Philipsen
Keyword(s):  
Decision Making ◽  
Attention Deficit Hyperactivity Disorder ◽  
Reinforcement Learning ◽  
Risk Taking ◽  
Attention Deficit ◽  
Meta Analysis ◽  
Analytic Approach ◽  
Effect Sizes ◽  
Hyperactivity Disorder ◽  
The Relationship

Background: Deficient decision-making (DM) in attention deficit/hyperactivity disorder (ADHD) is marked by altered reward sensitivity, higher risk taking, and aberrant reinforcement learning. Previous meta-analysis aggregate findings for the ADHD combined presentation (ADHD-C) mostly, while the ADHD predominantly inattentive presentation (ADHD-I) and the predominantly hyperactive/impulsive presentation (ADHD-H) were not disentangled. The objectives of the current meta-analysis were to aggregate findings from DM for each presentation separately.Methods: A comprehensive literature search of the PubMed (Medline) and Web of Science Database took place using the keywords “ADHD,” “attention-deficit/hyperactivity disorder,” “decision-making,” “risk-taking,” “reinforcement learning,” and “risky.” Random-effects models based on correlational effect-sizes were conducted. Heterogeneity analysis and sensitivity/outlier analysis were performed, and publication biases were assessed with funnel-plots and the egger intercept.Results: Of 1,240 candidate articles, seven fulfilled criteria for analysis of ADHD-C (N = 193), seven for ADHD-I (N = 256), and eight for ADHD-H (N = 231). Moderate effect-size were found for ADHD-C (r = 0.34; p = 0.0001; 95% CI = [0.19, 0.49]). Small effect-sizes were found for ADHD-I (r = 0.09; p = 0.0001; 95% CI = [0.008, 0.25]) and for ADHD-H (r = 0.1; p = 0.0001; 95% CI = [−0.012, 0.32]). Heterogeneity was moderate for ADHD-H. Sensitivity analyses show robustness of the analysis, and no outliers were detected. No publication bias was evident.Conclusion: This is the first study that uses a meta-analytic approach to investigate the relationship between the different presentations of ADHD separately. These findings provide first evidence of lesser pronounced impairment in DM for ADHD-I and ADHD-I compared to ADHD-C. While the exact factors remain elusive, the current study can be considered as a starting point to reveal the relationship of ADHD presentations and DM more detailed.

Are Challenge (Ropes) Courses an Effective Tool? A Meta-Analysis

2008 ◽  
Vol 31 (2) ◽  
pp. 111-135 ◽  
Author(s):  
H. Lee Gillis ◽  
Elizabeth Speelman
Keyword(s):  
Meta Analysis ◽  
Team Building ◽  
Effect Sizes ◽  
Ropes Course ◽  
Challenge Course ◽  
Study Characteristics ◽  
Standardized Mean Difference ◽  
Ropes Courses ◽  
Difference Effect

This study reports the results of a meta-analysis of 44 studies that examined the impacts of participation in challenge (ropes) course activities. Overall, a medium standardized mean difference effect size was found (d = 0.43). Effect sizes were calculated for various study characteristics, including demographics and outcome. Higher effects were found for adult groups (d = 0.80) and for studies measuring family functioning (d = 0.67). Studies with therapeutic (d = 0.53) or developmental foci (d = 0.47) had higher effect sizes than those with educational foci (d = 0.17). Higher effect sizes for group effectiveness (d = 0.62) affirmed the use of challenge course experiences for team-building purposes. Implications for further research include the importance of recording detailed program design information, selecting appropriate instrumentation, and including follow-up data.

scholarly journals Meta-Analysis of Randomized Controlled Trials on the Efficacy of Di’ao Xinxuekang Capsule and Isosorbide Dinitrate in Treating Angina Pectoris

2012 ◽  
Vol 2012 ◽  
pp. 1-8 ◽  
Author(s):  
Yongliang Jia ◽  
Cong Chen ◽  
Choi-San Ng ◽  
Siu-Wai Leung
Keyword(s):  
Sensitivity Analysis ◽  
Angina Pectoris ◽  
Randomized Controlled Trials ◽  
Isosorbide Dinitrate ◽  
Subgroup Analysis ◽  
Meta Analysis ◽  
Effect Sizes ◽  
Controlled Trials ◽  
Randomized Controlled ◽  
Study Characteristics

Objective. Randomized controlled trials (RCTs) on di’ao xinxuekang capsule (XXK) in treating angina pectoris were published only in Chinese and have not been systematically reviewed particularly for comparing XXK with isosorbide dinitrate (ISDN). This study aims to provide a comprehensive PRISMA compliant and internationally accessible systematic review and meta-analysis to evaluate the efficacies of XXK and ISDN in treating angina pectoris.Methods. The RCTs published between 1989 and 2011 on XXK and ISDN in treating angina pectoris were selected according to specific criteria. Meta-analysis was performed to evaluate the symptomatic (SYMPTOMS) and electrocardiographic (ECG) improvements after treatment. Odds ratios (OR) were used to measure effect sizes. Subgroup analysis, sensitivity analysis, and metaregression were conducted to evaluate the robustness of the results.Results. Seven RCTs with 550 participants were eligible. Overall ORs for comparing XXK with ISDN were 4.11 (95% CI :  2.57, 6.55) in SYMPTOMS and 2.37 (95% CI : 1.46, 3.84) in ECG. Subgroup analysis, sensitivity analysis, and metaregression found no significant dependence of overall ORs upon specific study characteristics.Conclusion. The meta-analysis of eligible but limited RCTs demonstrates that XXK seems to be more effective than ISDN in treating angina pectoris. Further RCTs of high quality are warranted to be conducted for update of the results of this meta-analysis.

scholarly journals Effectiveness of Sugary Drink Warnings: A Meta-Analysis of Experimental Studies

2020 ◽  
Vol 4 (Supplement_2) ◽  
pp. 1715-1715
Author(s):  
Anna Grummon ◽  
Hall Marissa
Keyword(s):  
Meta Analysis ◽  
Experimental Studies ◽  
Population Level ◽  
Emotional Reactions ◽  
The Body ◽  
Effect Sizes ◽  
Robert Wood Johnson Foundation ◽  
Added Sugar ◽  
Study Characteristics ◽  
Sugary Drink

Abstract Objectives Policymakers in five U.S. states have proposed sugary drink warnings. A growing number of experimental studies have examined sugary drink warnings’ impacts, but no research has synthesized this literature. To inform ongoing policy debates, this study aimed to identify, across the body of experimental studies, the effects of sugary drink warnings compared with control conditions. Methods In 2019, we systematically searched four databases using comprehensive search terms. We also searched reference lists of relevant articles. Two investigators independently screened titles, abstracts, and full-texts to identify peer-reviewed experiments that examined the effects of sugary drink warnings compared to a control condition. Two investigators independently extracted study characteristics and effect sizes from all relevant articles. We meta-analyzed any outcome assessed in at least two studies, combining effect sizes using random effects meta-analytic procedures. Results Twenty-three experiments with data on 16,241 individuals were included in the meta-analysis. Relative to control conditions, sugary drink warnings were more likely to be noticed (d with Hedges's correction = .83, 95% CI: .54, 1.12), caused stronger emotional reactions (d = .69, 95% CI: .25, 1.13) and elicited more thinking about health (d = .65, 95% CI: .29, 1.01). Sugary drink warnings also led to lower healthfulness perceptions (d = −.22, 95% CI: −.27, −.17) and stronger disease likelihood perceptions (d = .15, 95% CI: .06, .24). Moreover, sugary drink warnings reduced both hypothetical (d = −.32, 95% CI: −.44, −.21) and actual consumption and purchasing behavior (d = −.17, 95% CI: −.30, −.04). Significant effects were not observed for perceptions of added sugar (d = .25, 95% CI: −.05, .55) or positive sugary drink attitudes (d = −.54, 95% CI: −1.43, .35). Moderation analyses revealed that health warnings (e.g., “Beverages with added sugar contribute to obesity”) led to greater reductions in hypothetical SSB selection than did nutrient warnings (e.g., “High in sugar”, moderation P = .04). Conclusions Evidence from the experimental literature supports sugary drink warnings as a population-level strategy for changing behavior, as well as cognitions, emotions, perceptions, and intentions. Funding Sources Healthy Eating Research Program of the Robert Wood Johnson Foundation.

scholarly journals The effectiveness of nudging: A meta-analysis of choice architecture interventions across behavioral domains

2022 ◽  
Vol 119 (1) ◽  
pp. e2107346118
Author(s):  
Stephanie Mertens ◽  
Mario Herberz ◽  
Ulf J. J. Hahnel ◽  
Tobias Brosch
Keyword(s):  
Behavioral Interventions ◽  
Meta Analysis ◽  
Geographical Location ◽  
Target Population ◽  
Effect Sizes ◽  
Medium Effect ◽  
Choice Architecture ◽  
Study Characteristics ◽  
Contextual Study ◽  
Behavioral Domains

Over the past decade, choice architecture interventions or so-called nudges have received widespread attention from both researchers and policy makers. Built on insights from the behavioral sciences, this class of behavioral interventions focuses on the design of choice environments that facilitate personally and socially desirable decisions without restricting people in their freedom of choice. Drawing on more than 200 studies reporting over 450 effect sizes (n = 2,149,683), we present a comprehensive analysis of the effectiveness of choice architecture interventions across techniques, behavioral domains, and contextual study characteristics. Our results show that choice architecture interventions overall promote behavior change with a small to medium effect size of Cohen’s d = 0.45 (95% CI [0.39, 0.52]). In addition, we find that the effectiveness of choice architecture interventions varies significantly as a function of technique and domain. Across behavioral domains, interventions that target the organization and structure of choice alternatives (decision structure) consistently outperform interventions that focus on the description of alternatives (decision information) or the reinforcement of behavioral intentions (decision assistance). Food choices are particularly responsive to choice architecture interventions, with effect sizes up to 2.5 times larger than those in other behavioral domains. Overall, choice architecture interventions affect behavior relatively independently of contextual study characteristics such as the geographical location or the target population of the intervention. Our analysis further reveals a moderate publication bias toward positive results in the literature. We end with a discussion of the implications of our findings for theory and behaviorally informed policy making.

Methodological Guidance Paper: High-Quality Meta-Analysis in a Systematic Review

2019 ◽  
Vol 90 (1) ◽  
pp. 24-46 ◽  
Author(s):  
Terri D. Pigott ◽  
Joshua R. Polanin
Keyword(s):  
Systematic Review ◽  
Best Practice ◽  
Meta Analysis ◽  
Research Question ◽  
Effect Sizes ◽  
Statistical Techniques ◽  
High Quality ◽  
Systematic Review Methods ◽  
Study Results ◽  
Meta Analyses

This methodological guidance article discusses the elements of a high-quality meta-analysis that is conducted within the context of a systematic review. Meta-analysis, a set of statistical techniques for synthesizing the results of multiple studies, is used when the guiding research question focuses on a quantitative summary of study results. In this guidance article, we discuss the systematic review methods that support high-quality meta-analyses and outline best practice meta-analysis methods for describing the distribution of effect sizes in a set of eligible studies. We also provide suggestions for transparently reporting the methods and results of meta-analyses to influence practice and policy. Given the increasing use of meta-analysis for important policy decisions, the methods and results of meta-analysis should be both transparent and reproducible.

scholarly journals Race Comparisons on Need for Achievement: A Meta-Analytic Alternative to Graham’s Narrative Review

1995 ◽  
Vol 65 (4) ◽  
pp. 483-508 ◽  
Author(s):  
Harris Cooper ◽  
Nancy Dorr
Keyword(s):  
Meta Analysis ◽  
Race Differences ◽  
Self Concept ◽  
Need For Achievement ◽  
Race Difference ◽  
Lower Socioeconomic Status ◽  
Lower Socioeconomic ◽  
Blacks And Whites ◽  
The Difference ◽  
Method Of Assessment

A box score review conducted by Graham (1994) concluded that no difference existed between Blacks and Whites on measures of need for achievement. A meta-analysis reported in this article using the same research base revealed reliable and complex race differences. Overall, Whites scored higher than Blacks on measures of need for achievement, but the race difference all but disappeared in studies conducted after 1970. As a possible explanation, the meta-analysis revealed that since 1970 samples of participants from various socioeconomic levels have been preferred and that such samples showed differences between races of only half the size of those shown for samples of participants of strictly lower socioeconomic status. The method of assessment and the age and education of participants also influenced outcomes of race comparisons. Finally, Graham concluded that the research showed a consistent pattern of more positive self-concept of ability among Blacks than Whites. The meta-analysis also found this effect but revealed it to be smaller (though nonsignificantly so) than the difference in need for achievement rejected by the box score. Thus, the meta-analysis found that effects are no larger in an area where Graham concluded they existed than in an area where she concluded they did not.

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  
Keyword(s):  
Meta Analysis ◽  
R Package ◽  
Effect Sizes ◽  
Forest Plot ◽  
Point Estimates ◽  
Aggregate Effect ◽  
The Individual ◽  
Meta Analyses ◽  
Heterogeneous Effect ◽  
Intuitive Interpretation

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.

Sign in / Sign up

Export Citation Format

Share Document