[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Development and validation of a continuous measure of patient condition using the Electronic Medical Record

Published: 01 October 2013 Publication History

Abstract

Graphical abstractDisplay Omitted New method to estimate patient condition during a hospital visit.Patient condition is computed by summing risks measured in each of 26 variables.Leverages data already in the EMR: vital signs, lab results, nursing assessments.Rothman Index, a measure of patient condition, is independent of diagnosis and spans all acuity levels.May help clinicians to improve continuity of care and to detect trends. Patient condition is a key element in communication between clinicians. However, there is no generally accepted definition of patient condition that is independent of diagnosis and that spans acuity levels. We report the development and validation of a continuous measure of general patient condition that is independent of diagnosis, and that can be used for medical-surgical as well as critical care patients.A survey of Electronic Medical Record data identified common, frequently collected non-static candidate variables as the basis for a general, continuously updated patient condition score. We used a new methodology to estimate in-hospital risk associated with each of these variables. A risk function for each candidate input was computed by comparing the final pre-discharge measurements with 1-year post-discharge mortality. Step-wise logistic regression of the variables against 1-year mortality was used to determine the importance of each variable. The final set of selected variables consisted of 26 clinical measurements from four categories: nursing assessments, vital signs, laboratory results and cardiac rhythms. We then constructed a heuristic model quantifying patient condition (overall risk) by summing the single-variable risks. The model's validity was assessed against outcomes from 170,000 medical-surgical and critical care patients, using data from three US hospitals.Outcome validation across hospitals yields an area under the receiver operating characteristic curve(AUC) of 0.92when separating hospice/deceased from all other discharge categories, an AUC of 0.93 when predicting 24-h mortalityand an AUC of 0.62 when predicting 30-day readmissions. Correspondence with outcomesreflective of patient condition across the acuity spectrum indicates utility in both medical-surgical unitsand critical care units. The model output, which we call the Rothman Index, may provide clinicians witha longitudinal view of patient condition to help address known challenges in caregiver communication,continuity of care, and earlier detection of acuity trends.

References

[1]
Adams ST, Leveson SH. Clinical prediction rules. BMJ 2012;344.
[2]
D.D. Fraser, R.N. Singh, T. Frewen, The PEWS score: potential calling criteria for critical care response teams in children's hospitals, J Crit Care, 21 (2006) 278-279.
[3]
B.H. Cuthbertson, G.B. Smith, A warning on early-warning scores!, Br J Anaesth, 98 (2007) 704-706.
[4]
L. Liao, D.B. Mark, Clinical prediction models: are we building better mousetraps?, J Am Coll Cardiol, 42 (2003) 851-853.
[5]
B.H. Cuthbertson, M. Boroujerdi, L. McKie, Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient?, Crit Care Med, 35 (2007) 402-409.
[6]
M. Cretikos, J. Chen, K. Hillman, The objective medical emergency team activation criteria: a case-control study, Resuscitation, 73 (2007) 62-72.
[7]
M.A. Devita, R. Bellomo, K. Hillman, Findings of the first consensus conference on medical emergency teams, Crit Care Med, 34 (2006) 2463-2478.
[8]
H. Gao, A. McDonnell, D.A. Harrison, Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward, Intensive Care Med, 33 (2007) 667-679.
[9]
K. Hillman, J. Chen, M. Cretikos, Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial, Lancet, 365 (2005) 2091-2097.
[10]
C.P. Subbe, R.G. Davies, E. Williams, Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions, Anaesthesia, 58 (2003) 797-802.
[11]
B.D. Winters, J. Pham, P.J. Pronovost, Rapid response teams-walk, don't run, JAMA, 296 (2006) 1645-1647.
[12]
L. Egevad, T. Granfors, L. Karlberg, Prognostic value of the Gleason score in prostate cancer, BJU Int, 89 (2002) 538-542.
[13]
M. Berman, A. Stamler, G. Sahar, Validation of the 2000 Bernstein-Parsonnet score versus the EuroSCORE as a prognostic tool in cardiac surgery, Ann Thorac Surg, 81 (2006) 537-540.
[14]
A. Gogbashian, A. Sedrakyan, T. Treasure, EuroSCORE: a systematic review of international performance, Eur J Cardiothorac Surg, 25 (2004) 695-700.
[15]
M.M. Pollack, K.M. Patel, U.E. Ruttimann, PRISM III: an updated pediatric risk of mortality score, Crit Care Med, 24 (1996) 743-752.
[16]
H. Rexius, G. Brandrup-Wognsen, J. Nilsson, A simple score to assess mortality risk in patients waiting for coronary artery bypass grafting, Ann Thorac Surg, 81 (2006) 577-582.
[17]
W.A. Knaus, D.P. Wagner, E.A. Draper, The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults, Chest, 100 (1991) 1619-1636.
[18]
J.L. Vincent, R. Moreno, J. Takala, The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the working group on sepsis-related problems of the European society of intensive care medicine, Intensive Care Med, 22 (1996) 707-710.
[19]
C.P. Subbe, M. Kruger, P. Rutherford, Validation of a modified Early Warning Score in medical admissions, QJM, 94 (2001) 521-526.
[20]
Kirkland LL, Malinchoc M, O'Byrne M, et al. A Clinical Deterioration Prediction Tool for Internal Medicine Patients. American Journal of Medical Quality Published Online First: 19 July 2012.
[21]
G.J. Escobar, J.C. LaGuardia, B.J. Turk, Early detection of impending physiologic deterioration among patients who are not in intensive care: development of predictive models using data from an automated electronic medical record, J Hosp Med, 7 (2012) 388-395.
[22]
D.R. Prytherch, G.B. Smith, P.E. Schmidt, ViEWS-Towards a national early warning score for detecting adult inpatient deterioration, Resuscitation, 81 (2010) 932-937.
[23]
C.S. Parshuram, J. Hutchison, K. Middaugh, Development and initial validation of the Bedside Paediatric Early Warning System score, Crit Care, 13 (2009) R135.
[24]
McLellan MC, Connor JA. The Cardiac Children's Hospital Early Warning Score (C-CHEWS). J Pediatr Nurs Published Online First: 15 August 2012.
[25]
M.D. Buist, G.E. Moore, S.A. Bernard, Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study, BMJ, 324 (2002) 387-390.
[26]
U. Kyriacos, J. Jelsma, S. Jordan, Monitoring vital signs using early warning scoring systems: a review of the literature, J Nurs Manag, 19 (2011) 311-330.
[27]
H. Duncan, J. Hutchison, C.S. Parshuram, The pediatric early warning system score: a severity of illness score to predict urgent medical need in hospitalized children, J Crit Care, 21 (2006) 271-278.
[28]
Y. Mao, Y. Chen, G. Hackmann, Early deterioration warning for hospitalized patients by mining clinical data, IJDKB, 2 (2011) 1-20.
[29]
D.K. Richardson, J.E. Gray, M.C. McCormick, Score for neonatal acute physiology: a physiologic severity index for neonatal intensive care, Pediatrics, 91 (1993) 617-623.
[30]
Rothman MJ, Solinger AB, Rothman SI, et al. Clinical implications and validity of nursing assessments: a longitudinal measure of patient condition from analysis of the Electronic Medical Record. BMJ Open 2012;2.
[31]
L.C. Walter, R.J. Brand, S.R. Counsell, Development and validation of a prognostic index for 1-year mortality in older adults after hospitalization, JAMA, 285 (2001) 2987-2994.
[32]
H. Baid, The process of conducting a physical assessment: a nursing perspective, Br J Nurs, 15 (2006) 710-714.
[33]
S.D. Kerr, A comparison of four nursing documentation systems, J Nurs Staff Dev, 8 (1992) 27-31.
[34]
S.T. Adams, S.H. Leveson, Clinical prediction rules, BMJ, 344 (2012) d8312.
[35]
E.D. Boudreaux, J. Friedman, M.E. Chansky, Emergency department patient satisfaction: examining the role of acuity, Acad Emergy Med, 11 (2004) 162-168.
[36]
W.A. Grobman, D.M. Stamilio, Methods of clinical prediction, Am J Obstet Gynecol, 194 (2006) 888-894.
[37]
Lowry R. Concepts & Applications of Inferential Statistics,Chapter 14. 2012.
[38]
C.A. Kelly, A. Upex, D.N. Bateman, Comparison of consciousness level assessment in the poisoned patient using the alert/verbal/painful/unresponsive scale and the Glasgow Coma Scale, Ann Emergy Med, 44 (2004) 108-113.
[39]
Y. Higgins, C. Maries-Tillott, S. Quinton, Promoting patient safety using an early warning scoring system, Nurs Stand, 22 (2008) 35-40.
[40]
J.M. Bland, D.G. Altman, Validating scales and indexes, BMJ, 324 (2002) 606-607.
[41]
Van Walraven C, Dhalla IA, Bell C, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 2010;182(6).
[42]
P.K. Lindenauer, S.L. Normand, E.E. Drye, Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia, J Hosp Med, 6 (2011) 142-150.
[43]
O. Hasan, D.O. Meltzer, S.A. Shaykevich, Hospital readmission in general medicine patients: a prediction model, J Gen Intern Med, 25 (2010) 211-219.
[44]
G. Hripcsak, D.J. Albers, A. Perotte, Exploiting time in electronic health record correlations, J Am Med Inform Assoc, 18 (2011) i109-i115.
[45]
R.W. Duckitt, R. Buxton-Thomas, J. Walker, Worthing physiological scoring system: derivation and validation of a physiological early-warning system for medical admissions. An observational, population-based single-centre study, Br J Anaesth, 98 (2007) 769-774.
[46]
S.K. Inouye, P.N. Peduzzi, J.T. Robison, Importance of functional measures in predicting mortality among older hospitalized patients, JAMA, 279 (1998) 1187-1193.
[47]
K.D. Duncan, C. McMullan, B.M. Mills, Early warning systems: the next level of rapid response, Nursing, 42 (2012) 38-44.
[48]
M. Odell, C. Victor, D. Oliver, Nurses' role in detecting deterioration in ward patients: systematic literature review, J Adv Nurs, 65 (2009) 1992-2006.
[49]
M. Akre, M. Finkelstein, M. Erickson, Sensitivity of the pediatric early warning score to identify patient deterioration, Pediatrics, 125 (2010) e763-e769.
[50]
G.B. Smith, D.R. Prytherch, P.E. Schmidt, Review and performance evaluation of aggregate weighted 'track and trigger' systems, Resuscitation, 77 (2008) 170-179.
[51]
Kho A, Rotz D, Alrahi K, et al. Utility of commonly captured data from an EHR to identify hospitalized patients at risk for clinical deterioration. AMIA Annu Symp Proc 2007;404-8.
[52]
S.Y. Liaw, A. Scherpbier, P. Klainin-Yobas, A review of educational strategies to improve nurses' roles in recognizing and responding to deteriorating patients, Int Nurs Rev, 58 (2011) 296-303.
[53]
National Patient Safety Agency. Safer care for the acutely ill patient: learning from serious incidents. Available at: http://www.nrls.npsa.nhs.uk/resources/?EntryId45=59828; 2007.
[54]
Institute for Healthcare Improvement: Improving transitions in hospital care. (accessed 20 Feb2012).
[55]
Joint Commission Center for Transforming Healthcare: Hand-Off Communications Project. (accessed 20 Feb2012).
[56]
D. Tait, Nursing recognition and response to signs of clinical deterioration, Nurs Manag (Harrow), 17 (2010) 31-35.
[57]
A.S. Blouin, Improving hand-off communications: new solutions for nurses, J Nurs Care Qual, 26 (2011) 97-100.
[58]
D.W. Bates, A.A. Gawande, Improving safety with information technology, N Engl J Med, 348 (2003) 2526-2534.
[59]
M.J. Breslow, B.A. Rosenfeld, M. Doerfler, Effect of a multiple-site intensive care unit telemedicine program on clinical and economic outcomes: an alternative paradigm for intensivist staffing, Crit Care Med, 32 (2004) 31-38.
[60]
D.R. Goldhill, A.F. McNarry, Physiological abnormalities in early warning scores are related to mortality in adult inpatients¿, Br J Anaesth, 92 (2004) 882-884.
[61]
J. Cioffi, Nurses' experiences of making decisions to call emergency assistance to their patients, J Adv Nurs, 32 (2000) 108-114.
[62]
J. Kause, G. Smith, D. Prytherch, A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in australia and New Zealand, and the United Kingdom-the ACADEMIA study, Resuscitation, 62 (2004) 275-282.
[63]
K.M. Hillman, P.J. Bristow, T. Chey, Antecedents to hospital deaths, Int Med J, 31 (2001) 343-348.
[64]
Bradley EH, Yakusheva O, Horwitz LI, et al. Identifying patients at increased risk for unplanned readmission. Medical Care 2013, in press.
[65]
Tepas III JJ, Rimar JM, Hsiao AL, Nussbaum MS. Automated analysis of electronic medical record data reflects the pathophysiology of surgical complications. Surgery 2013, in press.

Cited By

View all
  • (2024)EHR-QCJournal of Biomedical Informatics10.1016/j.jbi.2023.104509147:COnline publication date: 1-Feb-2024
  • (2022)Predicting pharmacotherapeutic outcomes for type 2 diabetesJournal of Biomedical Informatics10.1016/j.jbi.2022.104001129:COnline publication date: 1-May-2022
  • (2022)Use of learning approaches to predict clinical deterioration in patients based on various variables: a review of the literatureArtificial Intelligence Review10.1007/s10462-021-09982-255:2(1055-1084)Online publication date: 1-Feb-2022
  • Show More Cited By
  1. Development and validation of a continuous measure of patient condition using the Electronic Medical Record

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image Journal of Biomedical Informatics
      Journal of Biomedical Informatics  Volume 46, Issue 5
      October, 2013
      193 pages

      Publisher

      Elsevier Science

      San Diego, CA, United States

      Publication History

      Published: 01 October 2013

      Author Tags

      1. Acuity score
      2. Deterioration
      3. Electronic health records
      4. Health status indicators
      5. Nursing assessments
      6. Patient condition

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 04 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)EHR-QCJournal of Biomedical Informatics10.1016/j.jbi.2023.104509147:COnline publication date: 1-Feb-2024
      • (2022)Predicting pharmacotherapeutic outcomes for type 2 diabetesJournal of Biomedical Informatics10.1016/j.jbi.2022.104001129:COnline publication date: 1-May-2022
      • (2022)Use of learning approaches to predict clinical deterioration in patients based on various variables: a review of the literatureArtificial Intelligence Review10.1007/s10462-021-09982-255:2(1055-1084)Online publication date: 1-Feb-2022
      • (2020)An Electronic Medical Record SystemInternational Journal of Extreme Automation and Connectivity in Healthcare10.4018/IJEACH.20200101052:1(68-102)Online publication date: 1-Jan-2020
      • (2020)Explaining an increase in predicted risk for clinical alertsProceedings of the ACM Conference on Health, Inference, and Learning10.1145/3368555.3384460(80-89)Online publication date: 2-Apr-2020
      • (2019)The Impact of Big Data on Health Care Services in AustraliaProceedings of the 2019 International Conference on Mathematics, Science and Technology Teaching and Learning10.1145/3348400.3348414(34-38)Online publication date: 28-Jun-2019
      • (2017)Learning to detect sepsis with a multitask Gaussian process RNN classifierProceedings of the 34th International Conference on Machine Learning - Volume 7010.5555/3305381.3305503(1174-1182)Online publication date: 6-Aug-2017
      • (2017)Learning from clinical judgmentsProceedings of the 34th International Conference on Machine Learning - Volume 7010.5555/3305381.3305388(60-69)Online publication date: 6-Aug-2017
      • (2017)Validating the Tele-diagnostic Potential of Affordable Thermography in a Big-data Data-enabled ICUProceedings of the Special Collection on eGovernment Innovations in India10.1145/3055219.3055234(64-69)Online publication date: 7-Mar-2017
      • (2017)Automatic recognition of symptom severity from psychiatric evaluation recordsJournal of Biomedical Informatics10.1016/j.jbi.2017.05.02075:S(S71-S84)Online publication date: 1-Nov-2017
      • Show More Cited By

      View Options

      View options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media