scholarly journals Making our “meta-hypotheses” clear: heterogeneity and the role of direct replications in science

2021 ◽  
Vol 11 (2) ◽  
Author(s):  
Eirik Strømland
Keyword(s):  
Early Phase ◽  
Scientific Literature ◽  
Replication Study ◽  
Effect Sizes ◽  
Mature Stage ◽  
Initial Finding ◽  
Replication Studies ◽  
Homogeneity Assumption ◽  
Scientific Status

AbstractThis paper argues that some of the discussion around meta-scientific issues can be viewed as an argument over different “meta-hypotheses” – assumptions made about how different hypotheses in a scientific literature relate to each other. I argue that, currently, such meta-hypotheses are typically left unstated except in methodological papers and that the consequence of this practice is that it is hard to determine what can be learned from a direct replication study. I argue in favor of a procedure dubbed the “limited homogeneity assumption” – assuming very little heterogeneity of effect sizes when a literature is initiated but switching to an assumption of heterogeneity once an initial finding has been successfully replicated in a direct replication study. Until that has happened, we do not allow the literature to proceed to a mature stage. This procedure will elevate the scientific status of direct replication studies in science. Following this procedure, a well-designed direct replication study is a means of falsifying an overall claim in an early phase of a literature and thus sets up a hurdle against the canonization of false facts in the behavioral sciences.

scholarly journals Role of Meta-analysis in Interpreting the Scientific Literature

2013 ◽  
Author(s):  
Michael D. Jennions ◽  
Christopher J. Lortie ◽  
Julia Koricheva
Keyword(s):  
Statistical Power ◽  
Scientific Literature ◽  
Meta Analysis ◽  
Effect Sizes ◽  
P Values ◽  
Single Study ◽  
Broad Scale

This chapter begins with a brief review of why effect sizes and their variances are more informative than P-values. It then discusses how meta-analysis promotes “effective thinking” that can change approaches to several commonplace problems. Specifically, it addresses the issues of (1) exemplar studies versus average trends, (2) resolving “conflict” between specific studies, (3) presenting results, (4) deciding on the level at which to replicate studies, (5) understanding the constraints imposed by low statistical power, and (6) asking broad-scale questions that cannot be resolved in a single study. The chapter focuses on estimating effect sizes as a key outcome of meta-analysis, but acknowledges that other outcomes might be of more interest in other situations.

scholarly journals Australian and Italian Psychologists’ View of Replication

2021 ◽  
Vol 4 (3) ◽  
pp. 251524592110392
Author(s):  
Franca Agnoli ◽  
Hannah Fraser ◽  
Felix Singleton Thorn ◽  
Fiona Fidler
Keyword(s):  
Experimental Method ◽  
Academic Research ◽  
Research Community ◽  
Replication Study ◽  
Actual Rate ◽  
Psychology Research ◽  
Psychological Literature ◽  
Replication Studies ◽  
Median Estimate

Solutions to the crisis in confidence in the psychological literature have been proposed in many recent articles, including increased publication of replication studies, a solution that requires engagement by the psychology research community. We surveyed Australian and Italian academic research psychologists about the meaning and role of replication in psychology. When asked what they consider to be a replication study, nearly all participants (98% of Australians and 96% of Italians) selected options that correspond to a direct replication. Only 14% of Australians and 8% of Italians selected any options that included changing the experimental method. Majorities of psychologists from both countries agreed that replications are very important, that more replications should be done, that more resources should be allocated to them, and that they should be published more often. Majorities of psychologists from both countries reported that they or their students sometimes or often replicate studies, yet they also reported having no replication studies published in the prior 5 years. When asked to estimate the percentage of published studies in psychology that are replications, both Australians (with a median estimate of 13%) and Italians (with a median estimate of 20%) substantially overestimated the actual rate. When asked what constitute the main obstacles to replications, difficulty publishing replications was the most frequently cited obstacle, coupled with the high value given to innovative or novel research and the low value given to replication studies.

Retóricas, metáforas y su papel en el cambio organizacional

Oikos ◽  
2014 ◽  
Vol 16 (33) ◽  
pp. 69
Author(s):  
Luis Muñoz Medina ◽  
Rafael Pizarro Rodríguez
Keyword(s):  
Scientific Literature ◽  
Organisational Change ◽  
Change Processes ◽  
Emotional Burden ◽  
New Approaches ◽  
Palabras Clave ◽  
The Creation ◽  
Change Concept

The Role of Rhetoric and Metaphors in Organisational Change  RESUMEN El presente artículo es una recopilación de literatura científica que demuestra la relevancia de comprender nuevas formas de construir el concepto de cambio organizacional a través del lenguaje, en especial a través de claves lingüísticas como la retórica y metáfora. Esta construcción ayuda a generar procesos de cambio organizacional que presenten una menor intensidad y carga emocional negativa para los individuos, así como una mejor comprensión del mismo cambio para los empleados. Palabras clave: cambio, organización, retórica, metáfora. ABSTRACT This article is a compilation of scientific literature about the importance of understanding new approaches to the construction of the organisational change concept through language, especially through linguistic devices such as rhetorical and metaphorical ones. This construction helps the creation of organisational change processes with lower levels of impact and a lower negative emotional burden for individuals as well as a better understanding of such changesKeywords: changes; organisation; rhetoric; metaphor. 

Identification of and Correction for Publication Bias: Comment

2019 ◽  
Author(s):  
Amanda Kvarven ◽  
Eirik Strømland ◽  
Magnus Johannesson
Keyword(s):  
Publication Bias ◽  
False Positive ◽  
Large Scale ◽  
Meta Analysis ◽  
False Positive Rate ◽  
Effect Sizes ◽  
Replication Studies ◽  
Moderate Reduction ◽  
Positive Rate ◽  
Meta Analyses

Andrews & Kasy (2019) propose an approach for adjusting effect sizes in meta-analysis for publication bias. We use the Andrews-Kasy estimator to adjust the result of 15 meta-analyses and compare the adjusted results to 15 large-scale multiple labs replication studies estimating the same effects. The pre-registered replications provide precisely estimated effect sizes, which do not suffer from publication bias. The Andrews-Kasy approach leads to a moderate reduction of the inflated effect sizes in the meta-analyses. However, the approach still overestimates effect sizes by a factor of about two or more and has an estimated false positive rate of between 57% and 100%.

Effectiveness of psychological interventions to improve emotion regulation in youth - a meta-analysis

2019 ◽  
Author(s):  
Bettina Moltrecht ◽  
Jessica Deighton ◽  
Praveetha Patalay ◽  
Julian Childs
Keyword(s):  
Emotion Regulation ◽  
Emotion Dysregulation ◽  
Psychological Intervention ◽  
Meta Analysis ◽  
Age Groups ◽  
Effect Sizes ◽  
What Works ◽  
Large Heterogeneity ◽  
Larger Sample

Background: Research investigating the role of emotion regulation (ER) in the development and treatment of psychopathology has increased in recent years. Evidence suggests that an increased focus on ER in treatment can improve existing interventions. Most ER research has neglected young people, therefore the present meta-analysis summarizes the evidence for existing psychosocial intervention and their effectiveness to improve ER in youth. Methods: A systematic review and meta-analysis was conducted according to the PRISMA guidelines. Twenty-one randomized-control-trials (RCTs) assessed changes in ER following a psychological intervention in youth exhibiting various psychopathological symptoms.Results: We found moderate effect sizes for current interventions to decrease emotion dysregulation in youth (g=-.46) and small effect sizes to improve emotion regulation (g=0.36). Significant differences between studies including intervention components, ER measures and populations studied resulted in large heterogeneity. Conclusion: This is the first meta-analysis that summarizes the effectiveness for existing interventions to improve ER in youth. The results suggest that interventions can enhance ER in youth, and that these improvements correlate with improvements in psychopathology. More RCTs including larger sample sizes, different age groups and psychopathologies are needed to increase our understanding of what works for who and when.

Formation of Adequate Self-Esteem in a Younger Schoolchild to Eliminate Manifestations of Deceit

2021 ◽  
pp. 45-47
Author(s):  
N. Pavlova
Keyword(s):  
Experimental Study ◽  
Primary School ◽  
Scientific Literature ◽  
Self Esteem ◽  
School Age ◽  
Methods And Techniques ◽  
Primary School Age

The article highlights the actual psychological and pedagogical problem of manifestation of a tendency to lie in children of primary school age. Based on the study of scientific literature on this topic and the results of an experimental study conducted in the second grades of primary school, the reasons for this communicative phenomenon and its relationship with the level of self-esteem of the child are analyzed. The formation of an adequate self-esteem in a younger student is seen as a means of eliminating his manifestations of deceit. The conditions, methods and techniques of pedagogical activity aimed at the formation of an adequate self-esteem of a younger student, and the role of a teacher in this process are revealed.

scholarly journals The enigmatic ribosomal stalk

2018 ◽  
Vol 51 ◽  
Author(s):  
Anders Liljas ◽  
Suparna Sanyal
Keyword(s):  
Early Phase ◽  
Ribosomal Subunit ◽  
Structure And Function ◽  
Large Ribosomal Subunit ◽  
Translation Factors ◽  
Ribosomal Stalk ◽  
And Function ◽  
High Degree

Abstract The large ribosomal subunit has a distinct feature, the stalk, extending outside the ribosome. In bacteria it is called the L12 stalk. The base of the stalk is protein uL10 to which two or three dimers of proteins bL12 bind. In archea and eukarya P1 and P2 proteins constitute the stalk. All these extending proteins, that have a high degree of flexibility due to a hinge between their N- and C-terminal parts, are essential for proper functionalization of some of the translation factors. The role of the stalk proteins has remained enigmatic for decades but is gradually approaching an understanding. In this review we summarise the knowhow about the structure and function of the ribosomal stalk till date starting from the early phase of ribosome research.

scholarly journals The Role of Effortful Control in Stuttering Severity in Children: Replication Study

2019 ◽  
Vol 28 (1) ◽  
pp. 14-28 ◽  
Author(s):  
Shelly Jo Kraft ◽  
Emily Lowther ◽  
Janet Beilby
Keyword(s):  
Effortful Control ◽  
Replication Study
Sign in / Sign up

Export Citation Format

Share Document