scholarly journals Development and validation of the predictive risk of death model for adult patients admitted to intensive care units in Japan: an approach to improve the accuracy of healthcare quality measures

2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Hideki Endo ◽  
Shigehiko Uchino ◽  
Satoru Hashimoto ◽  
Yoshitaka Aoki ◽  
Eiji Hashiba ◽  
...  

Abstract Background The Acute Physiology and Chronic Health Evaluation (APACHE) III-j model is widely used to predict mortality in Japanese intensive care units (ICUs). Although the model’s discrimination is excellent, its calibration is poor. APACHE III-j overestimates the risk of death, making its evaluation of healthcare quality inaccurate. This study aimed to improve the calibration of the model and develop a Japan Risk of Death (JROD) model for benchmarking purposes. Methods A retrospective analysis was conducted using a national clinical registry of ICU patients in Japan. Adult patients admitted to an ICU between April 1, 2018, and March 31, 2019, were included. The APACHE III-j model was recalibrated with the following models: Model 1, predicting mortality with an offset variable for the linear predictor of the APACHE III-j model using a generalized linear model; model 2, predicting mortality with the linear predictor of the APACHE III-j model using a generalized linear model; and model 3, predicting mortality with the linear predictor of the APACHE III-j model using a hierarchical generalized additive model. Model performance was assessed with the area under the receiver operating characteristic curve (AUROC), the Brier score, and the modified Hosmer–Lemeshow test. To confirm model applicability to evaluating quality of care, funnel plots of the standardized mortality ratio and exponentially weighted moving average (EWMA) charts for mortality were drawn. Results In total, 33,557 patients from 44 ICUs were included in the study population. ICU mortality was 3.8%, and hospital mortality was 8.1%. The AUROC, Brier score, and modified Hosmer–Lemeshow p value of the original model and models 1, 2, and 3 were 0.915, 0.062, and < .001; 0.915, 0.047, and < .001; 0.915, 0.047, and .002; and 0.917, 0.047, and .84, respectively. Except for model 3, the funnel plots showed overdispersion. The validity of the EWMA charts for the recalibrated models was determined by visual inspection. Conclusions Model 3 showed good performance and can be adopted as the JROD model for monitoring quality of care in an ICU, although further investigation of the clinical validity of outlier detection is required. This update method may also be useful in other settings.

2018 ◽  
Author(s):  
Azizeh Khaled Sowan ◽  
Meghan Leibas ◽  
Albert Tarriela ◽  
Charles Reed

BACKGROUND The integration of clinical practice guidelines (CPGs) into the nursing care plan and documentation systems aims to translate evidence into practice, improve safety and quality of care, and standardize care processes. OBJECTIVE This study aimed to evaluate nurses’ perceptions of the usability of a nursing care plan solution that includes 234 CPGs. METHODS A total of 100 nurses from 4 adult intensive care units (ICUs) responded to a survey measuring nurses’ perceptions of system usability. The survey included 37 rated items and 3 open-ended questions. RESULTS Nurses’ perceptions were favorable with more than 60.0% (60/100) in agreement on 12 features of the system and negative to moderate with 20.0% (20/100), to 59.0% (59/100) in agreement on 19 features. The majority of the nurses (80/100, 80.0% to 90/100, 90.0%) agreed on 4 missing safety features within the system. More than half of the nurses believed they would benefit from refresher classes on system use. Overall satisfaction with the system was just above average (54/100, 54.0%). Common positive themes from the narrative data were related to the system serving as a reminder for complete documentation and individualizing patient care. Common negative aspects were related to duplicate charting, difficulty locating CPGs, missing unit-specific CPGs, irrelevancy of information, and lack of perceived system value on patient outcomes. No relationship was found between years of system use or ICU experience and satisfaction with the system (P=.10 to P=.25). CONCLUSIONS Care plan systems in ICUs should be easy to navigate; support efficient documentation; present relevant, unit-specific, and easy-to-find information; endorse interdisciplinary communication; and improve safety and quality of care.


2013 ◽  
Vol 167 (1) ◽  
pp. 47 ◽  
Author(s):  
Jochen Profit ◽  
John A. F. Zupancic ◽  
Jeffrey B. Gould ◽  
Kenneth Pietz ◽  
Marc A. Kowalkowski ◽  
...  

2021 ◽  
Author(s):  
Oliver T. Nguyen ◽  
Amir Alishahi Tabriz ◽  
Jinhai Huo ◽  
Karim Hanna ◽  
Christopher M. Shea ◽  
...  

BACKGROUND E-visits involve asynchronous communication between providers and patients through a secure web-based platform, such as a patient portal, to elicit symptoms and determine a diagnosis and treatment plan. E-visits are now reimbursable through Medicare due to the COVID-19 pandemic. The state of the evidence regarding e-visits, such as the impact on clinical outcomes and healthcare delivery, is unclear. OBJECTIVE To address this gap, this systematic review examines how e-visits have impacted clinical outcomes and healthcare quality, access, utilization, and costs. METHODS MEDLINE, Embase, and Web of Science were searched from January 2000 through October 2020 for peer-reviewed studies that assessed e-visits’ impact on clinical and healthcare delivery outcomes. RESULTS Out of 1,858 papers, 19 studies met the inclusion criteria. E-visit usage was associated with improved or comparable clinical outcomes, especially for chronic disease management (e.g., diabetes care, blood pressure management). The impact on quality of care varied across conditions. Quality of care was equivalent or better for chronic conditions but variable quality was observed in infection management (e.g., appropriate antibiotic prescribing). Similarly, the impact on healthcare utilization varied across conditions (e.g., lower utilization for dermatology) but mixed impact in primary care. Healthcare costs were lower for e-visits for a wide-range of conditions (e.g., dermatology and acute visits). No studies examined the impact of e-visits on healthcare access. Available studies are observational in nature and it is difficult to draw firm conclusions about effectiveness or impact on care delivery. CONCLUSIONS Overall, the evidence suggests e-visits may provide comparable clinical outcomes to in-person care and reduce healthcare costs for certain healthcare conditions. At the same time, there is mixed evidence on healthcare quality, especially regarding infection management (e.g., sinusitis, urinary tract infections, conjunctivitis). Further studies are needed to test implementation strategies that might improve delivery (e.g., clinical decision support for antibiotic prescribing) and to assess which conditions are amenable to e-visits and which conditions require in-person or face-to-face care (e.g., virtual visit). CLINICALTRIAL not applicable


2017 ◽  
Vol 67 (664) ◽  
pp. e800-e815 ◽  
Author(s):  
Rishi Mandavia ◽  
Nishchay Mehta ◽  
Anne Schilder ◽  
Elias Mossialos

BackgroundProvider financial incentives are being increasingly adopted to help improve standards of care while promoting efficiency.AimTo review the UK evidence on whether provider financial incentives are an effective way of improving the quality of health care.Design and settingSystematic review of UK evidence, undertaken in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) recommendations.MethodMEDLINE and Embase databases were searched in August 2016. Original articles that assessed the relationship between UK provider financial incentives and a quantitative measure of quality of health care were included. Studies showing improvement for all measures of quality of care were defined as ‘positive’, those that were ‘intermediate’ showed improvement in some measures, and those classified as ‘negative’ showed a worsening of measures. Studies showing no effect were documented as such. Quality was assessed using the Downs and Black quality checklist.ResultsOf the 232 published articles identified by the systematic search, 28 were included. Of these, nine reported positive effects of incentives on quality of care, 16 reported intermediate effects, two reported no effect, and one reported a negative effect. Quality assessment scores for included articles ranged from 15 to 19, out of a maximum of 22 points.ConclusionThe effects of UK provider financial incentives on healthcare quality are unclear. Owing to this uncertainty and their significant costs, use of them may be counterproductive to their goal of improving healthcare quality and efficiency. UK policymakers should be cautious when implementing these incentives — if used, they should be subject to careful long-term monitoring and evaluation. Further research is needed to assess whether provider financial incentives represent a cost-effective intervention to improve the quality of care delivered in the UK.


2013 ◽  
Vol 21 (3) ◽  
pp. 765-772 ◽  
Author(s):  
Marcia Raquel Panunto ◽  
Edinêis de Brito Guirardello

OBJECTIVE: to evaluate the characteristics of the professional nursing practice environment and its relationship with burnout, perception of quality of care, job satisfaction and the intention to leave the job in the next 12 months. METHOD: cross-sectional study with a quantitative approach to data. The sample was composed of 129 nurses working in adult Intensive Care Units from a region in the interior of São Paulo, Brazil. RESULTS: The structural equation modeling, using path analysis, revealed that characteristics of the environment influence job satisfaction, perception of quality of care, and having an intention to leave their job, when mediated by emotional exhaustion. Nurses with limited autonomy, poor control over their practice, and poor relationships with physicians, experience a greater level of emotional exhaustion, which can negatively influence their perception of quality of care, job satisfaction and an intention to abandon their jobs. CONCLUSION: the mediating role of emotional exhaustion may negatively influence care delivery. Therefore, there is a need to adopt strategies to minimize this condition among nurses.


Sign in / Sign up

Export Citation Format

Share Document