scholarly journals Indicadores de gestão na revisão por pares: confiabilidade da revisão recíproca anônima de propostas de mestrado │ Peer review indicators: reliability of a reciprocal anonymous review of masters proposals

2013 ◽  
Vol 9 (1) ◽  
Author(s):  
Marta Denisczwicz ◽  
Vinícius Medina Kern
Keyword(s):  
Peer Review ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Systematic Study ◽  
Information Science ◽  
Intraclass Correlation ◽  
Scale Reliability ◽  
Absolute Measure ◽  
Masters Students

Resumo A revisão por pares é pobre em indicadores, apesar de sua importância. Este artigo apresenta indicadores de confiabilidade da revisão recíproca anônima de propostas de mestrado. Doze alunos de mestrado em Ciência da Informação deram pareceres anônimos sobre propostas de colegas em 7 itens avaliativos, usando escala Likert-6, sendo a confiabilidade calculada através de índices utilizados na literatura. A confiabilidade não é uma medida absoluta de qualidade, mas o cálculo desses indicadores permite estudar sistematicamente a qualidade da revisão por pares.Palavras-chave Revisão por pares, Confiabilidade, Concordância entre revisores, Coeficiente de correlação intraclasse, Revisão por pares na aprendizagem. Abstract Peer review lacks indicators, which is incongruent with its importance. This article reports the reliability of mutual, anonymous review of masters research proposals. Twelve masters students in Information Science refereed anonymously their peers' research proposals according to 7 evaluation items, using a Likert-6 scale. Reliability was expressed as intraclass correlation indices between 0.500 and 0.202, with 9 positive and 3 negative values - ​​lower than usual in professional processes. Reliability is not an absolute measure of quality, but calculating reliability allows for a systematic study of the quality of peer review.Keywords Peer review; Reliability; Agreement among referees; Intraclass correlation coefficient; Peer review in learning.

scholarly journals Patient assessment of constipation quality of life questionnaire: validity and reliability for Indonesian population

2019 ◽  
Vol 28 (4) ◽  
pp. 345-50
Author(s):  
Murdani Abdullah ◽  
Hasan Maulahela ◽  
Amanda Pitarini Utari ◽  
Pratiwi Dyah Kusumo ◽  
Amin Soebandrio ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Psychometric Evaluation ◽  
Average Score ◽  
Patient Assessment ◽  
Cronbach's Alpha ◽  
Sf 36

BACKGROUND Constipation is a condition commonly encountered by physicians, causing a significant reduction in patients’ quality of life. Therefore, successful management of constipation should also include increase the quality of life. The Patient Assessment of Constipation Quality of Life (PAC-QOL) questionnaire is a questionnaire developed to address this issue. However, this questionnaire had not been translated into the Indonesian language. This study was aimed to adapt PAC-QOL into Indonesian culture and perform the psychometric evaluation. METHODS Translation and cultural adaptation were performed based on the linguistic validation guidelines by Acquadro et al in 2012. To perform the psychometric evaluation, a total of 64 subjects in Petamburan district in Jakarta, Indonesia, were recruited from February to March 2018. Test-retest reliability was assessed by completing the PACQOL twice with one-week interval. Subjects also completed the Short Form 36 (SF-36) Health Survey Questionnaire to assess concurrent validity. Internal consistency was analyzed with Cronbach’s alpha value (>0.7) and the intraclass correlation coefficient. RESULTS The mean (standard deviation) overall average score was 1.52 (0.66), while the Cronbach’s alpha value for the overall average score was 0.910. Concurrently, the intraclass correlation coefficient for the overall score was 0.87. Simultaneously, several experts judged content validity to be adequate. All the questions had significant correlations with their respective domains. Moreover, each domain of PAC-QOL also had a significant correlation with several SF-36 domains. CONCLUSIONS The psychometric evaluation performed in this study demonstrated that the Indonesian version of the PAC-QOL was valid and reliable, suggesting that this questionnaire can be used in daily clinical practice.

Variation in tonsillectomy cost and revisit rates: analysis of administrative and billing data from US children’s hospitals

2020 ◽  
pp. bmjqs-2019-010730
Author(s):  
Sanjay Mahant ◽  
Troy Richardson ◽  
Ron Keren ◽  
Rajendu Srivastava ◽  
Jeremy Meier
Keyword(s):  
Quality Of Care ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Resource Use ◽  
Intraclass Correlation ◽  
Substantial Variation ◽  
Billing Data ◽  
Children's Hospitals ◽  
Children’S Hospitals

BackgroundTonsillectomy is one of the most common and cumulatively expensive surgical procedures in children. We determined if substantial variation in resource use, as measured by standardised costs, exists across hospitals for performing tonsillectomy and if higher resource use is associated with better quality of care, as measured by revisits to hospital.MethodsWe conducted a retrospective analysis of children undergoing routine outpatient tonsillectomy between 2011 to 2017 across US children's hospitals using an administrative and billing data source. The primary outcome measures were the hospital tonsillectomy standardised cost and the 30-day revisit rate to hospital. We analysed the interhospital variation in standardised cost by determining the number of outlier hospitals in standardised cost and the intraclass correlation coefficient.Results131 814 children (median age 6 years, IQR: 4,9; female sex 52.5%) underwent tonsillectomy for airway obstruction (62.9%) and infection (23.9%) across 28 hospitals. The median adjusted hospital standardised cost for tonsillectomy was $2392 (IQR: $1827, $2793; range: $1166 to $4222). There was substantial interhospital variation in costs as 11 (40%) hospitals were cost outliers, and the intraclass correlation coefficient was 0.62, suggesting that 62% of the variation in cost was attributable to variation between hospitals. The median hospital revisit rate was 9.5% (IQR: 7.8, 12.1) and higher hospital costs did not correlate with lower revisit rates (rs=0.03, 95% CI −0.36 to 0.41; p=0.87).ConclusionsThere is substantial variation in hospital resource use and standardised costs for routine outpatient tonsillectomy across US children’s hospitals. Higher resource use is not associated with lower revisit rates. Further study is needed to understand the practices of lower resource use hospitals who deliver high quality of care.

scholarly journals Development and psychometric properties of the Thai Graves’ ophthalmopathy quality of life (GO-QOL) questionnaire

2019 ◽  
Vol 4 (1) ◽  
Author(s):  
Mingkwan Lumyongsatien ◽  
Benjama Keeratidamkerngsakul ◽  
Kanokrat Pornpanich ◽  
Sumalee Vangveeravong ◽  
Preamjit Saonanon ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Psychometric Properties ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Clinical Activity ◽  
Life Questionnaire ◽  
Validity And Reliability ◽  
Graves Ophthalmopathy

Abstract Purpose To develop and assess the psychometric properties of the Thai version of the Graves’ Ophthalmopathy Quality of Life (GO-QOL) questionnaire. Background Graves’ ophthalmopathy (GO) is a chronic condition that causes negative self-image and impaired visual function. These conditions impact quality of life (QOL) but are rarely documented. Graves’ Ophthalmopathy Quality of Life Questionnaire (GO-QOL) has good validity, reliability and responsiveness. In this study we developed a Thai GO-QOL questionnaire by translating the questionnaire from English to the Thai language and evaluated its reliability and validity. Patients and methods Forward and backward translations were performed independently by four translators with extensive experience in both English and Thai. Seventy patients at the thyroid clinic responded to the Thai translated version upon their first visit and again 2–3 weeks afterwards. Validity was assessed by the content validity index (CVI) and correlation with relevant clinical parameters. Reliability was evaluated by Cronbach’s alpha, the intraclass correlation coefficient, and the Bland-Altman plot. Results The Thai GO-QOL version showed high CVI (0.97) and a moderate negative correlation of the functional QOL score with disease severity (r = − 0.49), the clinical activity score (r = − 0.31), and exposure parameter (r = − 0.32). It showed good reliability with a high intraclass correlation coefficient (0.92) and high Cronbach’ s coefficient (0.86). Conclusion The Thai GO-QOL has good validity and reliability. It can be used to evaluate the quality of life of Graves’ ophthalmopathy patients as a consequence of their disease in thyroid treatment programs.

scholarly journals Cross-cultural adaptation and psychometric properties of the Brazilian-Portuguese version of the Quality of Prenatal Care Questionnaire (QPCQ)

2019 ◽  
Vol 53 ◽  
pp. 1 ◽  
Author(s):  
Rodrigo Dias Nunes ◽  
Gabriel Cremona Parma ◽  
Andressa Cardoso de Campo ◽  
Paula Locatelli ◽  
Jefferson Traebert
Keyword(s):  
Item Response Theory ◽  
Prenatal Care ◽  
Item Response ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Response Theory ◽  
Altman Plot ◽  
Brazilian Version

OBJECTIVE: To translate and to observe the psychometric measures of the Brazilian version of the Quality of Prenatal Care Questionnaire. METHODS: The translation protocol followed the standards of the International Society for Pharmacoeconomics and Outcomes Research. Descriptive statistics were performed to identify characteristics of 280 literate postpartum women in a public hospital. We examined the internal consistency using Cronbach’s alfa. To determine the test-retest reproducibility and the instrument’s stability, we performed the intraclass correlation coefficient and Bland and Altman plot between two applications. We investigated the item’s properties using the item response theory. RESULTS: The overall Cronbach’s alpha index was 0.975. The intraclass correlation coefficient was 0.995 (95%CI 0.993–0.996) and a uniform distribution was visualized at the Bland and Altman plot. The item response theory identified the discriminatory power and the difficulty level of the instrument and of each item. The instrument showed acute angulation of the expected total score, and good concentrate information and good standard error curves, preserving the latent construct and its original items. CONCLUSIONS: This analysis concluded that the Brazilian version of the Quality of Prenatal Care Questionnaire is a high-quality, reliable and valid questionnaire to determine the quality of prenatal care among Brazilian women. The questionnaire is suitable for the cultural context represented.

scholarly journals Reliability of the NICMAN Scale: An Instrument to Assess the Quality of Acupuncture Administered in Clinical Trials

2017 ◽  
Vol 2017 ◽  
pp. 1-8 ◽  
Author(s):  
Caroline A. Smith ◽  
Christopher J. Zaslawski ◽  
Suzanne Cochrane ◽  
Xiaoshu Zhu ◽  
Zhen Zheng ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Kappa Statistic ◽  
Postgraduate Students ◽  
Intraclass Correlation Coefficients ◽  
Initial Stage

Background. The aim of this study was to examine the reliability of a scale to assess the methodological quality of acupuncture administered in clinical research. Methods. We invited 36 acupuncture researchers and postgraduate students to participate in the study. Firstly, participants rated two articles using the scale. Following this initial stage, modifications were made to scale items and the exercise was repeated. Interrater reliability was assessed for individual items using the Fleiss kappa statistic, whilst the overall scale used the intraclass correlation coefficient statistic. A threshold agreement of ≥0.61 was acceptable. Results. We received 26 responses and a 72% response rate. The first phase of testing found moderate reliability with intraclass correlation coefficients of 0.46 and 0.55 for the articles. The interrater reliability of the scales varied between and within the researchers (0.35, 0.60) and was more consistent with the postgraduate students (0.54, 0.54). Five items on the scale scored below the threshold and were revised for further testing. In this phase the intraclass correlation coefficient demonstrated variability between articles but improved to achieve reliability above the agreed threshold. Conclusion. This study provides evidence of the reliability of the NICMAN scale although improvements to a small number of items remain.

scholarly journals Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies

2018 ◽  
Vol 37 (18) ◽  
pp. 2734-2752 ◽  
Author(s):  
Shraddha Mehta ◽  
Rowena F. Bastero-Caballero ◽  
Yijun Sun ◽  
Ray Zhu ◽  
Diane K. Murphy ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Reliability Index ◽  
Intraclass Correlation ◽  
Scale Reliability

scholarly journals Biomechanical Measurement of Rabbit Cornea by a Modified Scheimpflug Device

2016 ◽  
Vol 2016 ◽  
pp. 1-6
Author(s):  
Bo Zhang ◽  
Jianjun Gu ◽  
Xiaoxiao Zhang ◽  
Bin Yang ◽  
Zheng Wang ◽  
...  
Keyword(s):  
Bulk Modulus ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Anterior Segment ◽  
Intraobserver Reliability ◽  
Rabbit Cornea ◽  
Deformation Response ◽  
Biomechanical Measurements ◽  
Biomechanical Measurement

Purpose. To explore the probability and variation in biomechanical measurements of rabbit cornea by a modified Scheimpflug device.Methods. A modified Scheimpflug device was developed by imaging anterior segment of the model imitating the intact eye at various posterior pressures. The eight isolated rabbit corneas were mounted on the Barron artificial chamber and images of the anterior segment were taken at posterior pressures of 15, 30, 45, 60, and 75 mmHg by the device. The repeatability and reliability of the parameters including CCT, ACD, ACV, and CV were evaluated at each posterior pressure. All the variations of the parameters at the different posterior pressures were calculated.Results. All parameters showed good intraobserver reliability (Cronbach’s alpha; intraclass correlation coefficient,α, ICC > 0.96) and repeatability in the modified Scheimpflug device. With the increase of posterior pressures, the ratio of CCT decreased linearly and the bulk modulus gradually reduced to a platform. The increase of ACD was almost linear with the posterior pressures elevated.Conclusions. The modified Scheimpflug device was a valuable tool to investigate the biomechanics of the cornea. The posterior pressure 15–75 mmHg range produced small viscoelastic deformations and nearly linear pressure-deformation response in the rabbit cornea.

scholarly journals A preliminary study of intensivist-performed DVT ultrasound screening in trauma ICU patients (APSIT Study)

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Lloyd Roberts ◽  
Tom Rozen ◽  
Deirdre Murphy ◽  
Adam Lawler ◽  
Mark Fitzgerald ◽  
...  
Keyword(s):  
Intensive Care ◽  
Deep Vein Thrombosis ◽  
High Risk ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Major Trauma ◽  
Intraclass Correlation ◽  
Trauma Patients ◽  
Vein Thrombosis ◽  
Deep Vein

Abstract Background Multiple screening Duplex ultrasound scans (DUS) are performed in trauma patients at high risk of deep vein thrombosis (DVT) in the intensive care unit (ICU). Intensive care physician performed compression ultrasound (IP-CUS) has shown promise as a diagnostic test for DVT in a non-trauma setting. Whether IP-CUS can be used as a screening test in trauma patients is unknown. Our study aimed to assess the agreement between IP-CUS and vascular sonographer performed DUS for proximal lower extremity deep vein thrombosis (PLEDVT) screening in high-risk trauma patients in ICU. Methods A prospective observational study was conducted at the ICU of Alfred Hospital, a major trauma center in Melbourne, Australia, between Feb and Nov 2015. All adult major trauma patients admitted with high risk for DVT were eligible for inclusion. IP-CUS was performed immediately before or after DUS for PLEDVT screening. The paired studies were repeated twice weekly until the DVT diagnosis, death or ICU discharge. Written informed consent from the patient, or person responsible, or procedural authorisation, was obtained. The individuals performing the scans were blinded to the others’ results. The agreement analysis was performed using Cohen’s Kappa statistics and intraclass correlation coefficient for repeated binary measurements. Results During the study period, 117 patients had 193 pairs of scans, and 45 (39%) patients had more than one pair of scans. The median age (IQR) was 47 (28–68) years with 77% males, mean (SD) injury severity score 27.5 (9.53), and a median (IQR) ICU length of stay 7 (3.2–11.6) days. There were 16 cases (13.6%) of PLEDVT with an incidence rate of 2.6 (1.6–4.2) cases per 100 patient-days in ICU. The overall agreement was 96.7% (95% CI 94.15–99.33). The Cohen’s Kappa between the IP-CUS and DUS was 0.77 (95% CI 0.59–0.95), and the intraclass correlation coefficient for repeated binary measures was 0.75 (95% CI 0.67–0.81). Conclusions There is a substantial agreement between IP-CUS and DUS for PLEDVT screening in trauma patients in ICU with high risk for DVT. Large multicentre studies are needed to confirm this finding.

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

Sign in / Sign up

Export Citation Format

Share Document