scholarly journals Accuracy and Effects of Clinical Decision Support Systems Integrated With BMJ Best Practice–Aided Diagnosis: Interrupted Time Series Study (Preprint)

2019 ◽  
Author(s):  
Liyuan Tao ◽  
Chen Zhang ◽  
Lin Zeng ◽  
Shengrong Zhu ◽  
Nan Li ◽  
...  

BACKGROUND Clinical decision support systems (CDSS) are an integral component of health information technologies and can assist disease interpretation, diagnosis, treatment, and prognosis. However, the utility of CDSS in the clinic remains controversial. OBJECTIVE The aim is to assess the effects of CDSS integrated with British Medical Journal (BMJ) Best Practice–aided diagnosis in real-world research. METHODS This was a retrospective, longitudinal observational study using routinely collected clinical diagnosis data from electronic medical records. A total of 34,113 hospitalized patient records were successively selected from December 2016 to February 2019 in six clinical departments. The diagnostic accuracy of the CDSS was verified before its implementation. A self-controlled comparison was then applied to detect the effects of CDSS implementation. Multivariable logistic regression and single-group interrupted time series analysis were used to explore the effects of CDSS. The sensitivity analysis was conducted using the subgroup data from January 2018 to February 2019. RESULTS The total accuracy rates of the recommended diagnosis from CDSS were 75.46% in the first-rank diagnosis, 83.94% in the top-2 diagnosis, and 87.53% in the top-3 diagnosis in the data before CDSS implementation. Higher consistency was observed between admission and discharge diagnoses, shorter confirmed diagnosis times, and shorter hospitalization days after the CDSS implementation (all <italic>P</italic>&lt;.001). Multivariable logistic regression analysis showed that the consistency rates after CDSS implementation (OR 1.078, 95% CI 1.015-1.144) and the proportion of hospitalization time 7 days or less (OR 1.688, 95% CI 1.592-1.789) both increased. The interrupted time series analysis showed that the consistency rates significantly increased by 6.722% (95% CI 2.433%-11.012%, <italic>P</italic>=.002) after CDSS implementation. The proportion of hospitalization time 7 days or less significantly increased by 7.837% (95% CI 1.798%-13.876%, <italic>P</italic>=.01). Similar results were obtained in the subgroup analysis. CONCLUSIONS The CDSS integrated with BMJ Best Practice improved the accuracy of clinicians’ diagnoses. Shorter confirmed diagnosis times and hospitalization days were also found to be associated with CDSS implementation in retrospective real-world studies. These findings highlight the utility of artificial intelligence-based CDSS to improve diagnosis efficiency, but these results require confirmation in future randomized controlled trials.

10.2196/16912 ◽  
2020 ◽  
Vol 8 (1) ◽  
pp. e16912 ◽  
Author(s):  
Liyuan Tao ◽  
Chen Zhang ◽  
Lin Zeng ◽  
Shengrong Zhu ◽  
Nan Li ◽  
...  

Background Clinical decision support systems (CDSS) are an integral component of health information technologies and can assist disease interpretation, diagnosis, treatment, and prognosis. However, the utility of CDSS in the clinic remains controversial. Objective The aim is to assess the effects of CDSS integrated with British Medical Journal (BMJ) Best Practice–aided diagnosis in real-world research. Methods This was a retrospective, longitudinal observational study using routinely collected clinical diagnosis data from electronic medical records. A total of 34,113 hospitalized patient records were successively selected from December 2016 to February 2019 in six clinical departments. The diagnostic accuracy of the CDSS was verified before its implementation. A self-controlled comparison was then applied to detect the effects of CDSS implementation. Multivariable logistic regression and single-group interrupted time series analysis were used to explore the effects of CDSS. The sensitivity analysis was conducted using the subgroup data from January 2018 to February 2019. Results The total accuracy rates of the recommended diagnosis from CDSS were 75.46% in the first-rank diagnosis, 83.94% in the top-2 diagnosis, and 87.53% in the top-3 diagnosis in the data before CDSS implementation. Higher consistency was observed between admission and discharge diagnoses, shorter confirmed diagnosis times, and shorter hospitalization days after the CDSS implementation (all P<.001). Multivariable logistic regression analysis showed that the consistency rates after CDSS implementation (OR 1.078, 95% CI 1.015-1.144) and the proportion of hospitalization time 7 days or less (OR 1.688, 95% CI 1.592-1.789) both increased. The interrupted time series analysis showed that the consistency rates significantly increased by 6.722% (95% CI 2.433%-11.012%, P=.002) after CDSS implementation. The proportion of hospitalization time 7 days or less significantly increased by 7.837% (95% CI 1.798%-13.876%, P=.01). Similar results were obtained in the subgroup analysis. Conclusions The CDSS integrated with BMJ Best Practice improved the accuracy of clinicians’ diagnoses. Shorter confirmed diagnosis times and hospitalization days were also found to be associated with CDSS implementation in retrospective real-world studies. These findings highlight the utility of artificial intelligence-based CDSS to improve diagnosis efficiency, but these results require confirmation in future randomized controlled trials.


2020 ◽  
Vol 7 (10) ◽  
Author(s):  
Catherine Liu ◽  
Kristine Lan ◽  
Elizabeth M Krantz ◽  
H Nina Kim ◽  
Jacqlynn Zier ◽  
...  

Abstract Background Inappropriate testing for Clostridioides difficile leads to overdiagnosis of C difficile infection (CDI). We determined the effect of a computerized clinical decision support (CCDS) order set on C difficile polymerase chain reaction (PCR) test utilization and clinical outcomes. Methods This study is an interrupted time series analysis comparing C difficile PCR test utilization, hospital-onset CDI (HO-CDI) rates, and clinical outcomes before and after implementation of a CCDS order set at 2 academic medical centers: University of Washington Medical Center (UWMC) and Harborview Medical Center (HMC). Results Compared with the 20-month preintervention period, during the 12-month postimplementation of the CCDS order set, there was an immediate and sustained reduction in C difficile PCR test utilization rates at both hospitals (HMC, −28.2% [95% confidence interval {CI}, −43.0% to −9.4%], P = .005; UWMC, −27.4%, [95% CI, −37.5% to −15.6%], P &lt; .001). There was a significant reduction in rates of C difficile tests ordered in the setting of laxatives (HMC, −60.8% [95% CI, −74.3% to −40.1%], P &lt; .001; UWMC, −37.3%, [95% CI, −58.2% to −5.9%], P = .02). The intervention was associated with an increase in the C difficile test positivity rate at HMC (P = .01). There were no significant differences in HO-CDI rates or in the proportion of patients with HO-CDI who developed severe CDI or CDI-associated complications including intensive care unit transfer, extended length of stay, 30-day mortality, and toxic megacolon. Conclusions Computerized clinical decision support tools can improve C difficile diagnostic test stewardship without causing harm. Additional studies are needed to identify key elements of CCDS tools to further optimize C difficile testing and assess their effect on adverse clinical outcomes.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Gulnoza Usmanova ◽  
Kamlesh Lalchandani ◽  
Ashish Srivastava ◽  
Chandra Shekhar Joshi ◽  
Deepak Chandra Bhatt ◽  
...  

Abstract Background Computerized clinical decision support (CDSS) –digital information systems designed to improve clinical decision making by providers – is a promising tool for improving quality of care. This study aims to understand the uptake of ASMAN application (defined as completeness of electronic case sheets), the role of CDSS in improving adherence to key clinical practices and delivery outcomes. Methods We have conducted secondary analysis of program data (government data) collected from 81 public facilities across four districts each in two sates of Madhya Pradesh and Rajasthan. The data collected between August –October 2017 (baseline) and the data collected between December 2019 – March 2020 (latest) was analysed. The data sources included: digitized labour room registers, case sheets, referral and discharge summary forms, observation checklist and complication format. Descriptive, univariate and multivariate and interrupted time series regression analyses were conducted. Results The completeness of electronic case sheets was low at postpartum period (40.5%), and in facilities with more than 300 deliveries a month (20.9%). In multivariate logistic regression analysis, the introduction of technology yielded significant improvement in adherence to key clinical practices. We have observed reduction in fresh still births rates and asphyxia, but these results were not statistically significant in interrupted time series analysis. However, our analysis showed that identification of maternal complications has increased over the period of program implementation and at the same time referral outs decreased. Conclusions Our study indicates CDSS has a potential to improve quality of intrapartum care and delivery outcome. Future studies with rigorous study design is required to understand the impact of technology in improving quality of maternity care.


1993 ◽  
Vol 32 (01) ◽  
pp. 12-13 ◽  
Author(s):  
M. A. Musen

Abstract:Response to Heathfield HA, Wyatt J. Philosophies for the design and development of clinical decision-support systems. Meth Inform Med 1993; 32: 1-8.


2006 ◽  
Vol 45 (05) ◽  
pp. 523-527 ◽  
Author(s):  
A. Abu-Hanna ◽  
B. Nannings

Summary Objectives: Decision Support Telemedicine Systems (DSTS) are at the intersection of two disciplines: telemedicine and clinical decision support systems (CDSS). The objective of this paper is to provide a set of characterizing properties for DSTSs. This characterizing property set (CPS) can be used for typing, classifying and clustering DSTSs. Methods: We performed a systematic keyword-based literature search to identify candidate-characterizing properties. We selected a subset of candidates and refined them by assessing their potential in order to obtain the CPS. Results: The CPS consists of 14 properties, which can be used for the uniform description and typing of applications of DSTSs. The properties are grouped in three categories that we refer to as the problem dimension, process dimension, and system dimension. We provide CPS instantiations for three prototypical applications. Conclusions: The CPS includes important properties for typing DSTSs, focusing on aspects of communication for the telemedicine part and on aspects of decisionmaking for the CDSS part. The CPS provides users with tools for uniformly describing DSTSs.


Sign in / Sign up

Export Citation Format

Share Document