ABSTRACTBackgroundIn locations where few people have received COVID-19 vaccines, health systems remain vulnerable to surges in SARS-CoV-2 infections. Tools to identify patients suitable for community-based management are urgently needed.MethodsWe prospectively recruited adults presenting to two hospitals in India with moderate symptoms of laboratory-confirmed COVID-19 in order to develop and validate a clinical prediction model to rule-out progression to supplemental oxygen requirement. The primary outcome was defined as any of the following: SpO2 < 94%; respiratory rate > 30 bpm; SpO2/FiO2 < 400; or death. We specified a priori that each model would contain three clinical parameters (age, sex and SpO2) and one of seven shortlisted biochemical biomarkers measurable using near-patient tests (CRP, D-dimer, IL-6, NLR, PCT, sTREM-1 or suPAR), to ensure the models would be suitable for resource-limited settings. We evaluated discrimination, calibration and clinical utility of the models in a temporal external validation cohort.Findings426 participants were recruited, of whom 89 (21·0%) met the primary outcome. 257 participants comprised the development cohort and 166 comprised the validation cohort. The three models containing NLR, suPAR or IL-6 demonstrated promising discrimination (c-statistics: 0·72 to 0·74) and calibration (calibration slopes: 1·01 to 1·05) in the validation cohort, and provided greater utility than a model containing the clinical parameters alone.InterpretationWe present three clinical prediction models that could help clinicians identify patients with moderate COVID-19 suitable for community-based management. The models are readily implementable and of particular relevance for locations with limited resources.FundingMédecins Sans Frontières, India.RESEARCH IN CONTEXTEvidence before this studyA living systematic review by Wynants et al. identified 137 COVID-19 prediction models, 47 of which were derived to predict whether patients with COVID-19 will have an adverse outcome. Most lacked external validation, relied on retrospective data, did not focus on patients with moderate disease, were at high risk of bias, and were not practical for use in resource-limited settings. To identify promising biochemical biomarkers which may have been evaluated independently of a prediction model and therefore not captured by this review, we searched PubMed on 1 June 2020 using synonyms of “SARS-CoV-2” AND [“biomarker” OR “prognosis”]. We identified 1,214 studies evaluating biochemical biomarkers of potential value in the prognostication of COVID-19 illness. In consultation with FIND (Geneva, Switzerland) we shortlisted seven candidates for evaluation in this study, all of which are measurable using near-patient tests which are either currently available or in late-stage development.Added value of this studyWe followed the TRIPOD guidelines to develop and validate three promising clinical prediction models to help clinicians identify which patients presenting with moderate COVID-19 can be safely managed in the community. Each model contains three easily ascertained clinical parameters (age, sex, and SpO2) and one biochemical biomarker (NLR, suPAR or IL-6), and would be practical for implementation in high-patient-throughput low resource settings. The models showed promising discrimination and calibration in the validation cohort. The inclusion of a biomarker test improved prognostication compared to a model containing the clinical parameters alone, and extended the range of contexts in which such a tool might provide utility to include situations when bed pressures are less critical, for example at earlier points in a COVID-19 surge.Implications of all the available evidencePrognostic models should be developed for clearly-defined clinical use-cases. We report the development and temporal validation of three clinical prediction models to rule-out progression to supplemental oxygen requirement amongst patients presenting with moderate COVID-19. The models are readily implementable and should prove useful in triage and resource allocation. We provide our full models to enable independent validation.
Trends in the conduct and reporting of clinical prediction model development and validation: a systematic review