Abstract
This study assesses the performance of National Early Warning Score (NEWS), Quick Sepsis-related Organ Failure Assessment (qSOFA), Modified Early Warning Score (MEWS), Rapid Emergency Medicine Score (REMS), and Rapid Acute Physiology Score (RAPS) in predicting emphysematous pyelonephritis (EPN) patients’ need for intensive care unit (ICU) admission. A retrospective analysis was conducted at four training and research hospitals’ emergency departments (EDs) on all EPN adult patients from January 2007 to August 2017. Data extracted were used to calculate raw scores for five physiologic scoring systems. Mann-Whitney U tests and χ2 tests were done for numerical and categorical variables respectively to examine differences between characteristics of ICU and non-ICU patient populations. Predictability of ICU admission was evaluated with AUROC analysis. ICU patients had lower GCS scores, SpO2, platelet counts, and estimated glomerular filtration rate; and higher bands, blood urea nitrogen, creatinine, and incidences of septic shock and nephrectomy. NEWS performed best, with 73.85% accuracy at optimal cut-off of 3. In this multicentre ED EPN series, we recommend using NEWS in early identification of critical EPN patients and advance planning for ICU admission. This would reduce delays in ICU transfer and ultimately improve patient outcomes.
Similar content being viewed by others
Introduction
Emphysematous pyelonephritis (EPN) is defined as an acute, severe necrotising infection of the renal parenchyma and its surrounding tissues that results in the presence of gas in the renal parenchyma, collecting system, or perinephric tissue1,2,3,4,5. It has historically been associated with high mortality rates of up to 78% in the 1970s, due to poor recognition of this rare condition leading to delayed management of septic complications; early nephrectomy was the treatment of choice, though with the advent of advanced imaging computed tomography techniques, percutaneous drainage is now the favoured option with decreased mortality of 21%6,7,8,9. Together with early percutaneous drainage, comprehensive management of EPN comprise fluid resuscitation, aggressive antibiotic therapy, correction of reversible precipitating factors, and elective nephrectomy if still indicated after percutaneous drainage10,11,12.
Despite the critical nature of these EPN patients, there is no global consensus of management algorithms for them in the emergency department (ED). Close, round-the-clock monitoring in the intensive care unit (ICU) is therefore warranted, so that clinicians can detect failure of conservative treatment promptly and perform timely percutaneous drainage and/or emergency nephrectomy.
Objective criteria to assess and predict an EPN patient’s need for ICU admission has however yet to be established despite its importance – admitting a patient who does not require ICU care exacerbates the overcrowding situation often seen in the ICU; on the contrary, failure or delays in admitting a patient who requires ICU care is associated with higher mortality rates13, potentially worsening survival further in this EPN patient population.
General guidelines for admission to the ICU are available from the Society of Critical Care Medicine14, though these recommendations are highly dependent on clinical expertise and experience. Additionally, there may be differences in opinions among emergency physicians (EPs), surgeons, and intensivists on whether ICU admission is really necessary.
National Early Warning Score (NEWS)15, Quick Sepsis Related Organ Failure Assessment (qSOFA)16, Modified Early Warning Score (MEWS)17, Rapid Emergency Medicine Score (REMS)18, and Rapid Acute Physiology Score (RAPS)19 (see Supplementary Tables S1–S5 online) are five physiologic scoring systems commonly used in the ED. These scoring systems consist of various readily-available parameters, thus allowing for point-of-care use to objectively assess the severity of an ED patient’s clinical condition and predict patient mortality.
We previously studied the use of such scoring systems in predicting mortality of patients with hepatic venous portal gas, splenic abscess, and renal abscess20,21,22,23. We found that Mortality in Emergency Department Sepsis score (MEDS) was superior to MEWS, REMS, and RAPS due to its incorporation of patient characteristics. We however excluded this score for the purposes of this study, as its basis of superiority in predicting mortality did not apply to the forecasting of need for ICU admission. In particular, the variable of “terminal illness” had the highest weightage in MEDS, yet such patients are generally managed palliatively in the general ward rather than aggressively in the ICU. With the utility of MEDS in predicting ICU admission curtailed, we substituted it with two other commonly used scoring systems, NEWS and qSOFA, in the design of this study.
This study examines the use of the aforementioned scoring systems to predict the need for ICU admission in EPN patients presenting to the ED. These results will assist EPs, surgeons, and intensivists in early identification of such critically-ill patients, enabling them to make the necessary arrangements with the ICU staff ahead of time.
Materials and Methods
Study design
A retrospective analysis was conducted at the EDs of four training and research hospitals of the respective sizes: Linkou Chang Gung Memorial Hospital (3406 beds, 17000 monthly ED visits); Kaohsiung Chang Gung Memorial Hospital (2686 beds, 12000 monthly ED visits); Chiayi Chang Gung Memorial Hospital (1375 beds, 5800 monthly ED visits); and Keelung Chang Gung Memorial Hospital (1089 beds, 5700 monthly ED visits). The Chang Gung Medical Foundation Institutional Review Board approved this study for all four hospitals (IRB No. 201701502B0C501), waiving the need for consent from study participants. Data was accessed anonymously. All methods were carried out in accordance with the relevant guidelines and regulations.
Settings and subjects
Patients older than 18 years admitted to the EDs of the four hospitals with EPN (diagnosed via clinical presentation and contrast-enhanced abdominal computed tomography scan) from January 2007 to August 2017 were recruited.
Measurement of variables
The following information were extracted from their medical records: age, sex, clinical presentation, temperature, heart rate, respiratory rate, blood pressure, Glasgow Coma Scale (GCS) score, radiographic imaging, and any other relevant data. The worst values observed during the patients’ ED stays were recorded. NEWS, qSOFA, MEWS, REMS, and RAPS were subsequently calculated for each patient. The study endpoint was admission to the ICU ward.
Criteria for ICU admission
Due to lack of consensus on specific international guidelines in determining need for ICU admission, our ICU committee has decided on the below-mentioned criteria to maximise patient prognoses and outcomes while reducing ICU overcrowding. These criteria have remained consistent throughout the study period.
The general criteria for ICU admission in our hospitals include at least one of the following: (1) requiring or likely to require advanced respiratory support; (2) requiring support of two or more organ systems; and (3) had chronic impairment of one or more organ systems and currently require support for an acute reversible failure of another organ.
Statistical analysis
Descriptive statistics were presented as median with interquartiles for numerical variables and frequencies with percentages (%) for categorical variables. Mann-Whitney U tests and χ2 tests were done for numerical and categorical variables respectively to examine the differences between characteristics of ICU and non-ICU patient populations24. Receiver operating characteristic curves were plotted for each score using logistic regression, to obtain the area under curve (AUC) value for comparison of ICU admission predictability. Optimal cut-off points were subsequently identified using Youden’s index, and the corresponding sensitivity, specificity, and accuracy rates calculated. DeLong test was also used to compare the AUC of NEWS with that of other scores. Statistical significance was taken at p < 0.05.
Results
A total of 65 patients aged between 33 and 89 years were identified in the four hospitals over a span of 10 years and 8 months. All recruited patients underwent abdominal CT scans. All patients were admitted to ICUs or general wards. None of them died in the EDs prior to admissions and none were transferred to other hospitals. Compared to the group of EPN patients who did not require ICU admission, those who were admitted to the ICU had lower GCS scores (p = 0.0070), lower SpO2 (p = 0.0036), higher incidence of septic shock (p < 0.0001), lower platelet counts (p = 0.0204), bandemia (p = 0.0058), higher blood urea nitrogen (p = 0.0123), higher creatinine (p = 0.0009), lower estimated glomerular filtration rate (p = 0.0010), higher incidence of nephrectomy (p < 0.0001) (Table 1).
AUROC analysis demonstrated the predictability of the five scoring systems as such, listed in descending order: NEWS, 0.8258; qSOFA, 0.7348; MEWS, 0.7040; REMS, 0.7035; RAPS, 0.6889 (Fig. 1). NEWS was found to be the best in predicting the need for ICU admission, with an optimal cut-off point of 3, sensitivity of 95.24%, specificity of 63.64%, positive predictive value of 55.56%, and negative predictive value of 96.55%. That of the other four physiologic scoring systems can be found in Table 2. Youden’s indices for the respective scores were as follows: NEWS 0.5887; qSOFA 0.3961; MEWS 0.3669; REMS 0.3398; and RAPS 0.3604. DeLong test found AUC of NEWS to be significantly larger than that of MEWS (p = 0.0256) and RAPS (p = 0.0486) (Table 3).
Discussion
This is a multi-centre study into EPN patients at the ED, as well as the first to assess the suitability of ED scoring systems in predicting ICU admission requirements for these patients. Five scoring systems were compared, and NEWS was found to be the best performer.
NEWS is an early warning score devised by the National Early Warning Score Development and Implementation Group (NEWSDIG) for the Royal College of Physicians to identify acutely ill patients requiring urgent assessment by a critical care team to determine necessity of escalation of care. It has been shown to be versatile, and has been validated for use in acute medical admissions15, non-elective surgical admissions25, and even in pre-hospital settings26,27. Previous studies have also found NEWS to be equal or superior to other commonly-used risk stratification tools, such as qSOFA, Systemic Inflammatory Response Syndrome score, and the medical emergency team criteria28,29.
Patients are classified into three categories dependent on their raw scores. Evaluation by a competent registered nurse is sufficient for a patient with a low score (NEWS 1–4), while those with a medium score (NEWS 5–6) should be reviewed by a ward-based doctor or acute team nurse. Patients with high scores (NEWS ≥7) require prompt emergency assessment by a clinical team skilled in critical care, and they are usually transferred to a higher dependency care area15.
Our similar study findings thus support the original recommendations of NEWS. EPN patients with a NEWS of the cut-off point 3 and below were unlikely to require ICU admission (NPV 96.55%) and can generally be transferred to the general ward. On the other hand, it is preferable to plan for ICU admission of those with scores of 4 and above, since the clinical situation of EPN patients can deteriorate rapidly without warning.
The overall mortality rate of patients admitted to the ICU in our study was 42.86%. We re-evaluated these cases and found that all 9 patients indeed had a NEWS above the optimal cut-off of 3, and thus would have been promptly identified. Furthermore, the low false negative incidence of 1.52% supports the conclusion that NEWS is a good discriminator in identifying EPN patients requiring ICU admission. This would ultimately streamline the decision-making process and improve quality of patient care.
Two other well-performing scores include qSOFA and MEWS, with cut-off scores in the studied EPN population which reflect the original designed intentions of each respective score. On the contrary, RAPS performed poorly, most probably since it was devised for use in a non-surgical ED patient population. This suggests that it is crucial for choice of any scoring system to take into consideration whether the patient in question is similar to the population for which the score was originally validated.
Further analysis with DeLong test confirmed the superiority of NEWS over MEWS and RAPS. DeLong test also favoured NEWS over qSOFA and REMS; with an increasing population size, the results should prove significant.
Upon examination of differences in characteristics between ICU and non-ICU patients, the statistically significant ones are as expected in a severely ill EPN patient. ICU patients were more likely to be in septic shock (p < 0.0001) with corresponding oxygen desaturation (p = 0.0036), lower GCS scores (p = 0.0070), lower platelet count (p = 0.0204), and bandemia (p = 0.0058) as well as worse renal function (higher BUN, p = 0.0123; higher creatinine, p = 0.0009; lower eGFR, p = 0.0010). Consequently, more ICU patients required nephrectomy (p < 0.0001). This then manifested as derangements in the EPN patients’ vital signs, which were incorporated in the NEWS physiologic scoring system.
NEWS is therefore an ideal objective assessment tool for the evaluation of need for ICU admission in EPN patients presenting to the ED. Its simplicity means that junior healthcare staff, including ED nurses, can employ the score even without much prior training, reducing uncertainty in patient management plans when senior physicians are tending to more urgent emergencies. Beds in the ICU can then be reserved for identified EPN patients to allow for seamless transfer. This pre-planned resource allocation and prioritization based on NEWS helps improve care efficiency and ultimately patient outcomes.
While results of this study is confined to EPN patients, further research can be done into the application of NEWS to other intra-abdominal infections. Furthermore, although this is a sizeable multicentre study comparatively to date into the population of EPN patients in the ED, the sample size is still small. Larger prospective studies are required to validate the results.
Looking into further improvements of the current NEWS system may also be warranted in the future. Particularly, the incidence of false positives and false negatives can be reduced by inclusion of supplementary indicators when conducting similar studies with larger sample populations.
Conclusion
In this multicentre ED EPN series, NEWS is the best performing physiologic score among the five scoring systems studied in identifying EPN patients who require ICU admission. Its simplicity allows for junior healthcare staff, including nurses, to utilize it for patient assessment without much prior training. We recommend using it in the planning of management of EPN patients, so as to reduce delays in transfer to the ICU and ultimately improve patient outcomes.
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Michaeli, J., Mogle, S., Perlberg, S., Heiman, S. & Caine, M. Emphysematous pyelonephritis. J. Urol. 131, 203–207 (1984).
Pontin, A. R., Barnes, R. D., Joffe, J. & Kahn, D. Emphysematous pyelonephritis in diabetic patients. Br. J. Urol. 75, 71–74 (1995).
Ubee, S. S., McGlynn, L. & Fordham, M. Emphysematous pyelonephritis. BJU Int. 107, 1474–1478 (2011).
Kumar, A., Turney, J. H., Brownjohn, A. M. & McMahon, M. J. Unusual bacterial infections of the urinary tract in diabetic patients–rare but frequently lethal. Nephrol. Dial. Transplant. 16, 1062 (2001).
Evanoff, G. V., Thompson, C. S., Foley, R. & Weinman, E. J. Spectrum of gas within the kidney. Emphysematous pyelonephritis and emphysematous pyelitis. Am. J. Med. 83, 149 (1987).
Shokeir, A. A., El-Azab, M., Mohsen, T. & El-Diasty, T. Emphysematous pyelonephritis: a 15-year experience with 20 cases. Urology. 49, 343–346 (1997).
Ahlering, T. E. et al. Emphysematous pyelonephritis: a 5-year experience with 13 patients. J. Urol. 134, 1086–1088 (1985).
Wan, Y. L., Lee, T. Y., Bullard, M. J. & Tsai, C. C. Acute gas-producing bacterial renal infection: correlation between imaging findings and clinical outcome. Radiology. 198, 433–438 (1996).
Chen, M. T. et al. Percutaneous drainage in the treatment of emphysematous pyelonephritis: 10-year experience. J. Urol. 157, 1569 (1997).
Huang, J. J. & Tseng, C. C. Emphysematous pyelonephritis: clinicoradiological classification, management, prognosis, and pathogenesis. Arch. Intern. Med. 160, 797–805 (2000).
Somani, B. K. et al. Is percutaneous drainage the new gold standard in the management of emphysematous pyelonephritis? Evidence from a systematic review. J. Urol. 179, 1844–1849 (2008).
Kapoor, R. et al. Predictive factors for mortality and need for nephrectomy in patients with emphysematous pyelonephritis. BJU Int. 105, 986–989 (2010).
Yu, B. H. Delayed admission to intensive care unit for critically surgical patients is associated with increased mortality. Am. J. Surg. 208, 268–274 (2014).
Nates, J. L. et al. ICU admission, discharge, and triage guidelines: a framework to enhance clinical operations, development of institutional policies, and further research. Crit. Care. Med. 44, 1553–1602 (2016).
Smith, G. B., Prytherch, D. R., Meredith, P., Schmidt, P. E. & Featherstone, P. I. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 84, 465–470 (2013).
Seymour, C. W. et al. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 315, 762–774 (2016).
Subbe, C. P., Kruger, M., Rutherford, P. & Gemmel, L. Validation of a modified Early Warning Score in medical admissions. QJM. 94, 521–526 (2001).
Olsson, T., Terent, A. & Lind, L. Rapid Emergency Medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients. J. Intern. Med. 255, 579–587 (2004).
Rhee, K. J., Fisher, C. J. Jr. & Willitis, N. H. The Rapid Acute Physiology Score. Am. J. Emerg. Med. 5, 278–282 (1987).
Seak, C. J. et al. Performance assessment of the Simplified Acute Physiology Score II, the Acute Physiology and Chronic Health Evaluation II score, and the Sequential Organ Failure Assessment score in predicting the outcomes of adult patients with hepatic portal venous gas in the ED. Am. J. Emerg. Med. 32, 1481–1484 (2014).
Seak, C. J. et al. Rapid Emergency Medicine Score: a novel prognostic tool for predicting the outcomes of adult patients with hepatic portal venous gas in the emergency department. PLoS ONE. 12, e0184813 (2017).
Hung, S. K. et al. Comparison of the Mortality in Emergency Department Sepsis Score, Modified Early Warning Score, Rapid Emergency Medicine Score, and Rapid Acute Physiology Score for predicting the outcomes of adult splenic abscess patients in the emergency department. PLoS ONE. 12, e0187495 (2017).
Chang, S. H. et al. Performance assessment of the Mortality in Emergency Department Sepsis Score, modified Early Warning Score, Rapid Emergency Medicine Score, and Rapid Acute Physiology Score in predicting survival outcomes of adult renal abscess patients in the emergency department. Biomed. Res. Int. 2018, 6983568 (2018).
Zhang, Z. Univariate description and bivariate statistical inference: the first step delving into data. Ann Transl Med. 4, 91 (2016).
Kovacs, C. et al. Comparison of the National Early Warning Score in non-elective medical and surgical patients. Br. J. Surg. 103, 1385–1393 (2016).
Silcock, D. J., Corfield, A. R., Gowens, P. A. & Rooney, K. D. Validation of the National Early Warning Score in the prehospital setting. Resuscitation. 89, 31–35 (2015).
Shaw, J., Fothergill, R. T., Clark, S. & Moore, F. Can the prehospital National Early Warning Score identify patients most at risk from subsequent deterioration? Emerg. Med. J. 34, 533–537 (2017).
Goulden, R. et al. qSOFA, SIRS and NEWS for predicting inhospital mortality and ICU admission in emergency admissions treated as sepsis. Emerg. Med. J. 35, 345–349 (2018).
Smith, G. B. et al. A comparison of the ability of the physiologic components of medical emergency team criteria and the U.K. National Early Warning Score to discriminate patients at risk of a range of adverse clinical outcomes. Crit. Care. Med. 44, 2171–2181 (2016).
Acknowledgements
We would like to thank the investigators of SPOT (Stratification to Prevent Overcrowding Taskforce). SPOT includes the following members: Nian-Ting Shie, Jia-Qi Xu, Chia-Hsun Chang, and Alexis Wong Ching. This study was supported by Chang Gung Memorial Hospital in Taiwan [grant numbers CORPG3H0231, CORPG3H0191, and CPRPG3D0012]. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author information
Authors and Affiliations
Contributions
Conceptualization, Z.N.L.G., C.K.S., J.C.Y.S. and C.J.S.; methodology, C.J.S.; formal analysis, K.H.H.; investigation, C.J.N., C.Y.C., C.H.L., Y.M.W., M.S.H., H.Y.C.; resources, C.J.N., C.Y.C., C.H.L., Y.M.W., M.S.H., H.Y.C.; data curation, X.H.Y.; writing—original draft preparation, X.H.Y. and C.J.S.; writing—review and editing, Z.N.L.G. and C.J.S.; visualization, K.H.H. and C.J.S.; supervision, C.J.S.; funding acquisition, C.J.S.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Yap, XH., Ng, CJ., Hsu, KH. et al. Predicting need for intensive care unit admission in adult emphysematous pyelonephritis patients at emergency departments: comparison of five scoring systems. Sci Rep 9, 16618 (2019). https://doi.org/10.1038/s41598-019-52989-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-52989-7
This article is cited by
-
The prognostic value of rapid risk scores among patients with community-acquired pneumonia
Wiener klinische Wochenschrift (2023)
-
Comparison of prognosis of five scoring systems in emphysematous pyelonephritis patients requiring intensive care
International Urology and Nephrology (2023)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.