scholarly journals An evaluation of Nephrology Literature for Transparency and Reproducibility Indicators: Cross-sectional Review

2019 ◽  
Author(s):  
Ian A. Fladie ◽  
Tomi Adewumi ◽  
Nam Vo ◽  
Daniel Tritz ◽  
Matt Vassar

AbstractBackgroundReproducibility is critical to diagnostic accuracy and treatment implementation. Concurrent with clinical reproducibility, research reproducibility establishes whether the use of identical study materials and methodologies in replication efforts permit researchers to arrive at similar results and conclusions. In this study, we address this gap by evaluating nephrology literature for common indicators of transparent and reproducible research.MethodsWe searched the National Library of Medicine catalog to identify 36 MEDLINE-indexed, English language nephrology journals. We randomly sampled 300 publications published between January 1, 2014, and December 31, 2018. In a duplicated and blinded fashion, two investigators screened and extracted data from the 300 publications.ResultsOur search yielded 28,835 publications, of which we randomly sampled 300 publications. Of the 300 publications, 152 (50.67%) were publicly available whereas 143 (47.67%) were restricted through paywall and 5 (1.67%) were inaccessible. Of the remaining 295 publications, 123 were excluded because they lack empirical data necessary for reproducibility. Of the 172 publications with empirical data, 43 (25%) reported data availability statements, 4 (2.33%) analysis scripts, 4 (2.33%) links to a protocol, and 10 (5.81%) were pre-registered.ConclusionOur study found that reproducible and transparent research practices are infrequently employed by the nephrology research community. Greater efforts should be made by both funders and journals, two entities that have the greatest ability to influence change. In doing so, an open science culture may eventually become the norm rather than the exception.

10.2196/16078 ◽  
2019 ◽  
Vol 2 (1) ◽  
pp. e16078
Author(s):  
J Michael Anderson ◽  
Andrew Niemann ◽  
Austin L Johnson ◽  
Courtney Cook ◽  
Daniel Tritz ◽  
...  

Background Reproducible research is a foundational component for scientific advancements, yet little is known regarding the extent of reproducible research within the dermatology literature. Objective This study aimed to determine the quality and transparency of the literature in dermatology journals by evaluating for the presence of 8 indicators of reproducible and transparent research practices. Methods By implementing a cross-sectional study design, we conducted an advanced search of publications in dermatology journals from the National Library of Medicine catalog. Our search included articles published between January 1, 2014, and December 31, 2018. After generating a list of eligible dermatology publications, we then searched for full text PDF versions by using Open Access Button, Google Scholar, and PubMed. Publications were analyzed for 8 indicators of reproducibility and transparency—availability of materials, data, analysis scripts, protocol, preregistration, conflict of interest statement, funding statement, and open access—using a pilot-tested Google Form. Results After exclusion, 127 studies with empirical data were included in our analysis. Certain indicators were more poorly reported than others. We found that most publications (113, 88.9%) did not provide unmodified, raw data used to make computations, 124 (97.6%) failed to make the complete protocol available, and 126 (99.2%) did not include step-by-step analysis scripts. Conclusions Our sample of studies published in dermatology journals do not appear to include sufficient detail to be accurately and successfully reproduced in their entirety. Solutions to increase the quality, reproducibility, and transparency of dermatology research are warranted. More robust reporting of key methodological details, open data sharing, and stricter standards journals impose on authors regarding disclosure of study materials might help to better the climate of reproducible research in dermatology.


2019 ◽  
Author(s):  
J Michael Anderson ◽  
Andrew Niemann ◽  
Austin L Johnson ◽  
Courtney Cook ◽  
Daniel Tritz ◽  
...  

BACKGROUND Reproducible research is a foundational component for scientific advancements, yet little is known regarding the extent of reproducible research within the dermatology literature. OBJECTIVE This study aimed to determine the quality and transparency of the literature in dermatology journals by evaluating for the presence of 8 indicators of reproducible and transparent research practices. METHODS By implementing a cross-sectional study design, we conducted an advanced search of publications in dermatology journals from the National Library of Medicine catalog. Our search included articles published between January 1, 2014, and December 31, 2018. After generating a list of eligible dermatology publications, we then searched for full text PDF versions by using Open Access Button, Google Scholar, and PubMed. Publications were analyzed for 8 indicators of reproducibility and transparency—availability of materials, data, analysis scripts, protocol, preregistration, conflict of interest statement, funding statement, and open access—using a pilot-tested Google Form. RESULTS After exclusion, 127 studies with empirical data were included in our analysis. Certain indicators were more poorly reported than others. We found that most publications (113, 88.9%) did not provide unmodified, raw data used to make computations, 124 (97.6%) failed to make the complete protocol available, and 126 (99.2%) did not include step-by-step analysis scripts. CONCLUSIONS Our sample of studies published in dermatology journals do not appear to include sufficient detail to be accurately and successfully reproduced in their entirety. Solutions to increase the quality, reproducibility, and transparency of dermatology research are warranted. More robust reporting of key methodological details, open data sharing, and stricter standards journals impose on authors regarding disclosure of study materials might help to better the climate of reproducible research in dermatology.


2019 ◽  
Author(s):  
Sheridan Evans ◽  
Ian A. Fladie ◽  
J. Michael Anderson ◽  
Daniel Tritz ◽  
Matt Vassar

AbstractBackgroundIn recent years, urgency has been placed on the “reproducibility crisis” facing biomedical research. Despite efforts toward improvement, certain elements needed to reproduce a study are often lacking from publications. The current state of reproducibility within the sports medicine research community remains unknown.PurposeOur study sought to evaluate the presence of eight indicators of reproducibility and transparency to determine the current state of research reporting in sports medicine research.Study DesignCross-sectional reviewMethodsUsing the National Library of Medicine catalog, we identified 41 MEDLINE-indexed, English language sports medicine journals. From the 41 journals, we randomly sampled 300 publications that were recorded on PubMed as being published between January 1, 2014, and December 31, 2018. Two investigators extracted data in duplicate and blinded fashion.ResultsOf the 300 publications sampled, 280 were accessible and were screened for empirical data. Studies that lack empirical data were excluded from our analysis. Of the remaining 195 with empirical data, 10 (5.13%) publications provided data availability statements, 1 (0.51%) provided a protocol, 0 (0.0%) provided an analysis script, and 9 (4.62%) were pre registered.ConclusionReproducibility and transparency indicators are lacking in sports medicine publications. The majority of publications lack the necessary resources for reproducibility such as material, data, analysis scripts, or protocol availability. While the current state of reproducibility cannot be fixed overnight, we feel combined efforts of data sharing, open access, and verifying disclosure statements can help to improve overall reporting.


2019 ◽  
Author(s):  
Ian A. Fladie ◽  
Sheridan Evans ◽  
Jake Checketts ◽  
Daniel Tritz ◽  
Brent Norris ◽  
...  

AbstractBackgroundScientific research is replete with poor accessibility to data, materials, and protocol, which limits the reproducibility of a study. Transparency with regard to materials, protocols, and raw data sets enhances reproducibility by providing the critical information necessary to verify, replicate, and resynthesize research findings. The extent to which transparency and reproducibility exist in the field of orthopaedics is unclear. In our study, we aimed to evaluate transparency and reproducibility-related characteristics of randomly sampled publications in orthopaedic journals.MethodsWe used the National Library of Medicine catalog to identify English language and MEDLINE-indexed orthopaedic journals. From the 74 journals meeting our inclusion criteria, we randomly sampled 300 publications using a refined PubMed search that were published between January 1, 2014, and December 31, 2018. Two investigators were trained for data extraction and analysis. Both investigators were blinded and independently extracted data from the 300 studies.ResultsOur initial search yielded 68,102 publications, from which we drew a random sample of 300 publications. Of these 300 publications, 286 were screened for empirical data and 14 were inaccessible. For analysis purposes, we excluded publications without empirical data. Of the 182 with empirical data, 13 studies (7.1%) included a data availability statement, 9 (4.9%) reported materials were available, none (0.0%) provided analysis scripts, 2 (1.1%) provided access to the protocol used, 5 (2.7%) were preregistered, and only 2 (1.1%) provided a statement about being a replicated study.ConclusionsComponents necessary for reproducibility are lacking in orthopaedic surgery journals. The vast majority of publications did not provide data or material availability statements, protocols, or analysis scripts, and had no preregistration statements. Intervention is needed to improve reproducibility in the field of orthopaedics. The current state of reproducibility in orthopaedic surgery could be improved by combined efforts from funding agencies, authors, peer reviewers, and journals alike.Level of EvidenceN/A


2019 ◽  
Author(s):  
J. Michael Anderson ◽  
Bryan Wright ◽  
Daniel Tritz ◽  
Jarryd Horn ◽  
Ian Parker ◽  
...  

AbstractBackgroundThe extent of reproducibility in cardiology research remains unclear. Therefore, our main objective was to determine the quality of research published in cardiology journals using eight indicators of reproducibility.MethodsUsing a cross-sectional study design, we conducted an advanced search of the National Library of Medicine (NLM) catalog for publications from 2014-2018 in journals pertaining to cardiology. Journals must have been published in the English language and must have been indexed in MEDLINE. Once the initial list of publications from all cardiology journals was obtained, we searched for full-text PDF versions using Open Access, Google Scholar, and PubMed. Studies were analyzed using a pilot-tested Google Form to evaluate the presence of information that was deemed necessary to reproduce the study in its entirety.ResultsAfter exclusions, we included 132 studies containing empirical data. Of these studies, the majority (126/132, 95.5%) did not provide the raw data collected while conducting the study, 0/132 (0%) provided step-by-step analysis scripts, and 117/132 (88.6%) failed to provide sufficient materials needed to reproduce the study.ConclusionsThe presentation of studies published in cardiology journals does not appear to facilitate reproducible research. Considerable improvements to the framework of biomedical science, specifically in the field of cardiology, are necessary. Solutions to increase the reproducibility and transparency of published works in cardiology journals is warranted, including addressing inadequate sharing of materials, raw data, and key methodological details.


2020 ◽  
Author(s):  
Matheus Pereira Lobo

A huge collaborative open science model is proposed. Many authors collaborating in a paper leads to a substantial reduction for the Article Processing Charges (APCs) in the Open Access Journals. This can significantly stimulate research within a healthier citizen and open science culture.


2019 ◽  
Vol 15 (3) ◽  
Author(s):  
Nur Raihan Ismail ◽  
Noor Aman Hamid

Introduction: The prevalence of obesity has been rising, adding to morbidity and mortality. As the proportion of elderly aged 60 years and above grows, so too the prevalence of obesity among this population. Obesity in the elderly is a rapidly growing public health concern as it contributes to significant changes in the health of older people. Objective: This review aims to assess the contributory factors for obesity in the elderly over the past decade. Methods: A literature search was conducted. The search was restricted to articles written in the English language published from 2008 to 2018. Qualitative studies were excluded. Results: A total of 19 full articles were retrieved, of which 18 cross-sectional and one cohort were included. The contributory factors were divided into three components: (a) socio demographic characteristics, (b) medical history and dietary factors and (c) environmental factors. Conclusions: This review informs an emerging knowledge regarding contributory factors for obesity and has implications for future education and program intervention in fighting obesity in the elderly.


2020 ◽  
Vol 47 (3) ◽  
pp. 547-560 ◽  
Author(s):  
Darush Yazdanfar ◽  
Peter Öhman

PurposeThe purpose of this study is to empirically investigate determinants of financial distress among small and medium-sized enterprises (SMEs) during the global financial crisis and post-crisis periods.Design/methodology/approachSeveral statistical methods, including multiple binary logistic regression, were used to analyse a longitudinal cross-sectional panel data set of 3,865 Swedish SMEs operating in five industries over the 2008–2015 period.FindingsThe results suggest that financial distress is influenced by macroeconomic conditions (i.e. the global financial crisis) and, in particular, by various firm-specific characteristics (i.e. performance, financial leverage and financial distress in previous year). However, firm size and industry affiliation have no significant relationship with financial distress.Research limitationsDue to data availability, this study is limited to a sample of Swedish SMEs in five industries covering eight years. Further research could examine the generalizability of these findings by investigating other firms operating in other industries and other countries.Originality/valueThis study is the first to examine determinants of financial distress among SMEs operating in Sweden using data from a large-scale longitudinal cross-sectional database.


Antibiotics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 250
Author(s):  
Louise Witteman ◽  
Herman A. van Wietmarschen ◽  
Esther T. van der Werf

Due to the excessive use of antibiotic and antimycotic treatments, the risk of resistant microbes and fungi is rapidly emerging. Previous studies have demonstrated that many women with (recurrent) urinary tract infection (UTI) and/or vaginal infections (VIs) welcome alternative management approaches to reduce the use of antibiotics and antifungals and avoid short- and long-term adverse effects. This study aims to determine which complementary medicine (CM) and self-care strategies are being used by women suffering from (recurrent) UTI and VI in The Netherlands and how they perceive their effectiveness in order to define directions for future research on safety, cost-effectiveness, and implementation of best practices. A cross-sectional online survey was performed among women, ≥18 years old, with a history of UTIs; 162 respondents were included in the data analysis, with most participants aged between 50 and 64 years (36.4%). The women reported having consulted a CM practitioner for UTI-specific symptoms (23.5%) and VI-specific symptoms (13.6%). Consultations of homeopaths, acupuncturists, and herbal physicians are most often reported. Overall, 81.7% of the women suffering from UTI used complementary or self-care strategies besides regular treatment, and 68.7% reported using CM/self-care strategies to treat vaginal symptoms. UTI- related use of cranberries (51.9%), vitamin C (43.8%), and D-mannose (32.7%) were most reported. Perceived effectiveness was mostly reported for homeopathic remedies and D-mannose. The results showed a substantial burden of UTI and VI on daily and sexual activities. Besides the frequency of use, the indication of perceived effectiveness seems to be an important parameter for further and rigorously designed research to encourage nonantibiotic/antifungal treatment implementation into daily clinical practice.


Medicina ◽  
2021 ◽  
Vol 57 (2) ◽  
pp. 109
Author(s):  
Alberto Forte ◽  
Giuseppe Sarli ◽  
Lorenzo Polidori ◽  
David Lester ◽  
Maurizio Pompili

Background and objectives: Suicide in adolescents represents a major public health concern. To date, a growing number of suicide preventive strategies based on the use of new technologies are emerging. We aimed to provide an overview of the present literature on the use of new technologies in adolescent suicide prevention. Materials and methods: An electronic search was run using the following keywords: Technology OR Technologies OR APP OR Application OR mobile application) AND (Adolescent OR youth OR puberty) AND (Suicid* OR Self-harm OR self-destruction). Inclusion criteria were: English language, published in a peer-reviewed journal, suicide prevention with the use of new technologies among adolescents. Results: Our search strategy yielded a total of 12 studies on the use of telemedicine, 7 on mobile applications, and 3 on language detection. We also found heterogeneity regarding the study design: 3 are randomized controlled trials (RCT), 13 are open-label single group trials, 2 are randomized studies, and 1 is a cross-sectional study. Telemedicine was the most adopted tool, especially web-based approaches. Mobile applications mostly focused on screening of depressive symptoms and suicidal ideation, and for clinical monitoring through the use of text messages. Although telepsychiatry and mobile applications can provide a fast and safe tool, supporting and preceding a face-to-face clinical assessment, only a few studies demonstrated efficacy in preventing suicide among adolescents through the use of these interventions. Some studies suggested algorithms able to recognize people at risk of suicide from the exploration of the language on social media posts. Conclusions: New technologies were found to be well accepted and tolerated supports for suicide prevention in adolescents. However, to date, few data support the use of such interventions in clinical practice and preventive strategies. Further studies are needed to test their efficacy in suicide prevention among adolescents and young adults.


Sign in / Sign up

Export Citation Format

Share Document