Use of Text Searching for Trigger Words in Medical Records to Identify Adverse Drug Reactions within an Intensive Care Unit Discharge Summary

Summary

Purpose

To evaluate the performance of using trigger words (e.g. clues to an adverse drug reaction) in unstructured, narrative text to detect adverse drug reactions (ADRs) and compare the use of these trigger words to a targeted chart review for ADR detection within the intensive care unit (ICU) discharge summary note.

Materials

A retrospective medical record review was conducted. Evaluation of ADRs occurred in two phases – targeted chart review of the ICU discharge summary notes in Phase 1 and targeted chart review using specific words and phrases as triggers for ADRs in Phase 2.

Results

Four hundred ADRs were documented in 223 patients for Phase 1. For Phase 2, there were 219 ADRs identified in 120 patients. 138 real or accurate ADRs were identified from Phase 1 and 47 duplicate events. 34 ADRs from Phase 2 were not identified in Phase 1. Fifteen of the ADRs were inaccurately presumed in Phase 2. Fifty-eight of 127 text triggers identified at least one ADR. Low and moderate frequency trigger words were more likely to have PPVs > 5%.

Conclusions

Targeted chart review using specific words and phrases as triggers for ADRs is a reasonable approach to identify ADRs and may save time compared to other methods after further refinement leads to a more accurately performing trigger word list.

Citation: Kane-Gill SL, MacLasco AM, Saul MI, Politz Smith TR, Kloet MA, Kim C, Anthes AM, Smithburger PL, Seybert AL. Use of text searching for trigger words in medical records to identify adverse drug reactions within an intensive care unit discharge summary.

Keywords

Drug-related side effects and adverse reactions - medication errors - patient safety - medical informatics applications - medical record systems - computerized - intensive care units - critical care

• References

• 1 Kohn LT, Corrigan JM, Donaldson MS, McKay T, Pike KC. To err is human. Washington, DC: National Academy Press; 2000
• 2 Cullen DJ, Bates DW, Small SD, Cooper JB, Nemeskal AR, Leape LL. The incident reporting system does not detect adverse drug events: a problem for quality improvement. Jt Comm J Qual Improv 1995; 21: 541-548.
• 3 Kane-Gill SL, Devlin JW. Adverse Drug Event Reporting in Intensive Care Units: A survey of current practices. Ann Pharmacother 2006; 40: 1267-1273.
• 4 Jha AK, Kuperman GJ, Teich JM, Leape L, Shea B, Rettenberg E, Burdick E, Seger DL, Vander Vilet M, Bates DW. Identifying adverse drug events: development of a computer-based monitor and comparison with chart review and stimulated voluntary report. J Am Med Inform Assoc 1998; 05: 305-314.
• 5 Kane-Gill SL, Bellamy CJ, Vericco MM, Handler SM, Weber RJ. Evaluation the positive predictive values of antidote signals to detect potential adverse drug reactions (ADRs) in the medical intensive care unit (ICU). Pharmacoepidemiol Drug Saf 2009; 18: 1185-1191.
• 6 Levinson DR. Hospital incident reporting systems do not capture most patient harm. 2012 Available from: psnet.ahrq.gov/resource.aspx?resourceID=23842 [accessed 02.16.16].
• 7 Stockwell DC, Kane-Gill SL. Developing a patient safety surveillance system to identify adverse events in the intensive care unit. Crit Care Med 2010; 38: S117-S125.
• 8 Brennan TA, Localio AR, Leape LL, Laird NM, Peterson L, Hiatt H, Barnes BA. Identification of adverse events occurring during hospitalization. Ann Intern Med 1990; 112: 221-226.
• 9 Murff HJ, Patel VL, Hripcsak G, Bates DW. Detecting adverse events for patient safety research: a review of current methodologies. J Biomed Inform 2003; 36: 131-143.
• 10 Beckmann U, Bohringer C, Carless R, Gillies DM, Runciman WB, Wu AW, Pronovost P. Evaluation of two methods for quality improvement in intensive care: facilitated incident monitoring and retrospective medical chart review. Crit Care Med 2003; 31: 1006-1011.
• 11 Murff HJ, Forster AJ, Peterson JF, Fiskio JM, Heiman HL, Bates DW. Electronically screening discharge summaries for adverse medical events. J Am Med Inform Assoc 2003; 10: 339-350.
• 12 Anthes AM, Harinstein LM, Smithburger PL, Seybert AL, Kane-Gill SL. Improving adverse drug event detection in critically ill patients through screening intensive care unit transfer summaries. Pharmacoepidemiol Drug Saf 2013; 22: 510-516.
• 13 Forster AJ, Andrade J, van Walraven C. Validation of a discharge summary term search method to detect adverse events. J Am Med Inform Assoc 2005; 12: 200-206.
• 14 Cullen DJ, Sweitzer BJ, Bates DW, Burdick E, Edmondson A, Leape LL. Preventable adverse drug events in hospitalized patients: a comparative study of intensive care and general care units. Crit Care Med 1997; 25: 1289-1297.
• 15 Kane-Gill SL, Kowiatek JG, Weber RJ. A comparison of voluntarily reported medication errors in the intensive care and general care units. Qual Saf Health Care 2010; 19: 55-59.
• 16 Latif A, Rawat N, Pustavoitau A, Pronovost PJ, Pham JC. National study of the distribution, causes, and consequences of voluntarily reported medication errors between ICU and non-ICU settings. Crit Care Med 2013; 41: 389-398.
• 17 Hiatt HH, Barnes BA, Brennan TA, Laird NM, Lawthers AG, Leape LL, Localio AR, Newhouse JP. A study of medical injury and medical malpractice. N Engl J Med 1989; 321: 480-484.
• 18 Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH. Incidence of adverse events and negligence in hospitalized patients: results of the Harvard Medical Practice Study I. N Engl J Med 1991; 324: 370-376.
• 19 National Coordinating Council on Medication Error Reporting and Prevention. Medication error index. 2001 Available from: http://www.nccmerp.org/types-medication-errors [accessed 02.16.16].
• 20 Miller MR, Clark JS, Lehmann CU. Computer based medication error reporting: insights and implications. Qual Saf Health Care 2006; 15: 208-213.
• 21 Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C. Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have a place. Qual Saf Health Care 2007; 16: 40-44.
• 22 Wang G, Jung K, Winnenburg R, Shah NH. A method for systematic discovery of adverse drug events from clinical notes. J Am Med Inform Assoc 2015; 22: 1196-1204.