Fully non-parametric receiver operating characteristic curve estimation for random-effects meta-analysis

2016 ◽  
Vol 26 (1) ◽  
pp. 5-20 ◽  
Author(s):  
Pablo Martínez-Camblor
2018 ◽  
Vol 28 (5) ◽  
pp. 1564-1578
Author(s):  
Alba M Franco-Pereira ◽  
Christos T Nakas ◽  
Alexander B Leichtle ◽  
M Carmen Pardo

Assessment of the diagnostic accuracy of biomarkers through receiver operating characteristic curve analysis frequently involves a limit of detection imposed by the laboratory analytical system precision. As a consequence, measurements below a certain level are undetectable and ignoring these is known to lead to negatively biased estimates of the area under the receiver operating characteristic curve. In this article, we introduce two receiver operating characteristic curve-based parametric approaches that tackle the issue of correct assessment of diagnostic markers in the presence of a limit of detection. Proposed approaches are simulation-based utilising bootstrap methodology. Non-parametric alternatives that are naively used in the literature do not solve the inherent problem of limit of detection values which are treated as censored observations. However, the latter seems to perform adequately well in our simulation study. Nonparametric bootstrap was consistently used throughout, while other bootstrap alternatives performed similarly in our pilot simulation study. The simulation study involves the comparison of parametric and non-parametric options described here versus alternative strategies that are routinely used in the literature. We apply all methods to a study-setting resembling a chemical quasi-standard situation, where compound tumour biomarkers were searched within a multi-variable set of measurements to discriminate between two groups, namely colorectal cancer and controls. We focus in the assessment of glutamine and methionine.


2019 ◽  
Vol 30 (7-8) ◽  
pp. 221-228
Author(s):  
Shahab Hajibandeh ◽  
Shahin Hajibandeh ◽  
Nicholas Hobbs ◽  
Jigar Shah ◽  
Matthew Harris ◽  
...  

Aims To investigate whether an intraperitoneal contamination index (ICI) derived from combined preoperative levels of C-reactive protein, lactate, neutrophils, lymphocytes and albumin could predict the extent of intraperitoneal contamination in patients with acute abdominal pathology. Methods Patients aged over 18 who underwent emergency laparotomy for acute abdominal pathology between January 2014 and October 2018 were randomly divided into primary and validation cohorts. The proposed intraperitoneal contamination index was calculated for each patient in each cohort. Receiver operating characteristic curve analysis was performed to determine discrimination of the index and cut-off values of preoperative intraperitoneal contamination index that could predict the extent of intraperitoneal contamination. Results Overall, 468 patients were included in this study; 234 in the primary cohort and 234 in the validation cohort. The analyses identified intraperitoneal contamination index of 24.77 and 24.32 as cut-off values for purulent contamination in the primary cohort (area under the curve (AUC): 0.73, P < 0.0001; sensitivity: 84%, specificity: 60%) and validation cohort (AUC: 0.83, P < 0.0001; sensitivity: 91%, specificity: 69%), respectively. Receiver operating characteristic curve analysis also identified intraperitoneal contamination index of 33.70 and 33.41 as cut-off values for feculent contamination in the primary cohort (AUC: 0.78, P < 0.0001; sensitivity: 87%, specificity: 64%) and validation cohort (AUC: 0.79, P < 0.0001; sensitivity: 86%, specificity: 73%), respectively. Conclusions As a predictive measure which is derived purely from biomarkers, intraperitoneal contamination index may be accurate enough to predict the extent of intraperitoneal contamination in patients with acute abdominal pathology and to facilitate decision-making together with clinical and radiological findings.


2021 ◽  
pp. 096228022199595
Author(s):  
Yalda Zarnegarnia ◽  
Shari Messinger

Receiver operating characteristic curves are widely used in medical research to illustrate biomarker performance in binary classification, particularly with respect to disease or health status. Study designs that include related subjects, such as siblings, usually have common environmental or genetic factors giving rise to correlated biomarker data. The design could be used to improve detection of biomarkers informative of increased risk, allowing initiation of treatment to stop or slow disease progression. Available methods for receiver operating characteristic construction do not take advantage of correlation inherent in this design to improve biomarker performance. This paper will briefly review some developed methods for receiver operating characteristic curve estimation in settings with correlated data from case–control designs and will discuss the limitations of current methods for analyzing correlated familial paired data. An alternative approach using conditional receiver operating characteristic curves will be demonstrated. The proposed approach will use information about correlation among biomarker values, producing conditional receiver operating characteristic curves that evaluate the ability of a biomarker to discriminate between affected and unaffected subjects in a familial paired design.


Sign in / Sign up

Export Citation Format

Share Document