Preventing Diagnostic Errors in Ambulatory Care: An Electronic Notification Tool for Incomplete Radiology Tests

Abstract

Background Failure to complete recommended diagnostic tests may increase the risk of diagnostic errors.

Objectives The aim of this study is to develop and evaluate an electronic monitoring tool that notifies the responsible clinician of incomplete imaging tests for their ambulatory patients.

Methods A results notification workflow engine was created at an academic medical center. It identified future appointments for imaging studies and notified the ordering physician of incomplete tests by secure email. To assess the impact of the intervention, the project team surveyed participating physicians and measured test completion rates within 90 days of the scheduled appointment. Analyses compared test completion rates among patients of intervention and usual care clinicians at baseline and follow-up. A multivariate logistic regression model was used to control for secular trends and differences between cohorts.

Results A total of 725 patients of 16 intervention physicians had 1,016 delayed imaging studies; 2,023 patients of 42 usual care clinicians had 2,697 delayed studies. In the first month, physicians indicated in 23/30 cases that they were unaware of the missed test prior to notification. The 90-day test completion rate was lower in the usual care than intervention group in the 6-month baseline period (18.8 vs. 22.1%, p = 0.119). During the 12-month follow-up period, there was a significant improvement favoring the intervention group (20.9 vs. 25.5%, p = 0.027). The change was driven by improved completion rates among patients referred for mammography (21.0 vs. 30.1%, p = 0.003). Multivariate analyses showed no significant impact of the intervention.

Conclusion There was a temporal association between email alerts to physicians about missed imaging tests and improved test completion at 90 days, although baseline differences in intervention and usual care groups limited the ability to draw definitive conclusions. Research is needed to understand the potential benefits and limitations of missed test notifications to reduce the risk of delayed diagnoses, particularly in vulnerable patient populations.

Keywords

diagnostic error - results management - patient safety - radiology - electronic alerts and reminders

Protection of Human and Animal Subjects

This project was reviewed in advance by the Tufts Health Sciences Institutional Review Board (IRB) and determined to be a quality improvement project exempt from IRB review.

• References

• 1 Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med 2005; 165 (13) 1493-1499
• 2 Singh H, Schiff GD, Graber ML, Onakpoya I, Thompson MJ. The global burden of diagnostic errors in primary care. BMJ Qual Saf 2017; 26 (06) 484-494
• 3 CRICO Strategies. 2018 CBS Benchmarking Report, Medical Malpractice in America. Boston, MA; 2018
• 4 CRICO Strategies. 2014 CBS Benchmarking report, Malpractice Risks in the Diagnostic Process. Boston, MA; 2014
• 5 Hanscom R, Small M, Lambrecht A. A dose of insight. Boston, MA: Coverys; , March 2018. Available at: https://www.coverys.com/Knowledge-Center/A-Dose-of-Insight__Diagnostic-Accuracy . Accessed September 8, 2019
• 6 Newman-Toker DE, Schaffer AC, Yu-Moe CW. , et al. Serious misdiagnosis-related harms in malpractice claims: The “Big Three” - vascular events, infections, and cancers. Diagnosis (Berl) 2019; 6 (03) 227-240
• 7 Errors D. Technical Series on Safer Primary Care. Geneva: World Health Organization; 2016. . License: CC BY-NC-SA 3.0 IGO. Available at: https://apps.who.int/iris/bitstream/handle/10665/252410/9789241511636-eng.pdf;jsessionid=2B91A13CFDB3BE01B21DBEDEFAB810DB?sequence=1 . Accessed December 21, 2019
• 8 Croskerry P. The importance of cognitive errors in diagnosis and strategies to minimize them. Acad Med 2003; 78 (08) 775-780
• 9 Groopman J. How Doctors Think. New York City, New York: Houghton Mifflin; 2007
• 10 Kahneman D. Thinking, Fast, and Slow. New York City, New York: Farrar, Straus, Giroux; 2011
• 11 Gandhi TK, Kachalia A, Thomas EJ. , et al. Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims. Ann Intern Med 2006; 145 (07) 488-496
• 12 National Academies of Sciences, Engineering, and Medicine. Improving Diagnosis in Health Care. Washington, DC: The National Academies Press; 2015
• 13 Bhise V, Sittig DF, Vaghani V, Wei L, Baldwin J, Singh H. An electronic trigger based on care escalation to identify preventable adverse events in hospitalised patients. BMJ Qual Saf 2018; 27 (03) 241-246
• 14 Schiff G. , Ed. Getting Results: Reliably Communicating and Acting on Critical Test Results. Oakbrook Terrace, IL: Joint Commission Resources; 2006
• 15 Murphy DR, Wu L, Thomas EJ, Forjuoh SN, Meyer AN, Singh H. Electronic trigger-based intervention to reduce delays in diagnostic evaluation for cancer: a cluster randomized controlled trial. J Clin Oncol 2015; 33 (31) 3560-3567
• 16 Emani S, Sequist TD, Lacson R. , et al. Ambulatory safety nets to reduce missed and delayed diagnoses of cancer. Jt Comm J Qual Patient Saf 2019; 45 (08) 552-557
• 17 Danforth KN, Smith AE, Loo RK, Jacobsen SJ, Mittman BS, Kanter MH. Electronic clinical surveillance to improve outpatient care: diverse applications within an integrated delivery system. EGEMS (Wash DC) 2014; 2 (01) 1056
• 18 Singh H, Hirani K, Kadiyala H. , et al. Characteristics and predictors of missed opportunities in lung cancer diagnosis: an electronic health record-based study. J Clin Oncol 2010; 28 (20) 3307-3315
• 19 Callen JL, Westbrook JI, Georgiou A, Li J. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med 2012; 27 (10) 1334-1348
• 20 Weingart SN, Stoffel EM, Chung DC. , et al. Delayed workup of rectal bleeding in adult primary care: examining process-of-care failures. Jt Comm J Qual Patient Saf 2017; 43 (01) 32-40
• 21 Medical liability: missed follow-ups a potent triggers of lawsuits. amednews.com, July 15, 2013. Available at: https://amednews.com/article/20130715/profession/130719980/2/ . Accessed December 21, 2019
• 22 Singh H, Thomas EJ, Mani S. , et al. Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential?. Arch Intern Med 2009; 169 (17) 1578-1586
• 23 O AlRowaili M. Ahmed AE, Areabi HA. Facotrs associated with no-shows and rescheduling MRI appointments. BMC Health Serv Res 2016; 6: 679
• 24 Mander GTW, Reynolds L, Cook A, Kwan MM. Factors associated with appointment non-attendance at a medical imaging department in regional Australia: a retrospective cohort analysis. J Med Radiat Sci 2018; 65 (03) 192-199
• 25 Harvey HB, Liu C, Ai J. , et al. Predicting no-shows in radiology using regression modeling of data available in the electronic medical record. J Am Coll Radiol 2017; 14 (10) 1303-1309
• 26 Rosenbaum JI, Mieloszyk RJ, Hall CS, Hippe DS, Gunn ML, Bhargava P. Understanding why patients no-show: observations of 2.9 million outpatient imaging visits over 16 years. J Am Coll Radiol 2018; 15 (07) 944-950
• 27 Pace LE, Percac-Lima S, Nguyen KH. , et al. Comparing diagnostic evaluations for rectal bleeding and breast lumps in primary care: a retrospective cohort study. J Gen Intern Med 2019; 34 (07) 1146-1153
• 28 Weingart SN, Saadeh MG, Simchowitz B. , et al. Process of care failures in breast cancer diagnosis. J Gen Intern Med 2009; 24 (06) 702-709
• 29 Puliti D, Bucchi L, Mancini S. , et al; IMPACT COHORT Working Group. Advanced breast cancer rates in the epoch of service screening: The 400,000 women cohort study from Italy. Eur J Cancer 2017; 75: 109-116
• 30 Liu C, Harvey HB, Jaworsky C, Shore MT, Guerrier CE, Pianykh O. Text message reminders reduce outpatient radiology no-shows but do not improve arrival punctuality. J Am Coll Radiol 2017; 14 (08) 1049-1054
• 31 Phillips L, Hendren S, Humiston S, Winters P, Fiscella K. Improving breast and colon cancer screening rates: a comparison of letters, automated phone calls, or both. J Am Board Fam Med 2015; 28 (01) 46-54
• 32 Zapka J, Taplin SH, Price RA, Cranos C, Yabroff R. Factors in quality care--the case of follow-up to abnormal cancer screening tests--problems in the steps and interfaces of care. J Natl Cancer Inst Monogr 2010; 2010 (40) 58-71
• 33 DeFrank JT, Rimer BK, Gierisch JM, Bowling JM, Farrell D, Skinner CS. Impact of mailed and automated telephone reminders on receipt of repeat mammograms: a randomized controlled trial. Am J Prev Med 2009; 36 (06) 459-467
• 34 Freund KM, Battaglia TA, Calhoun E. , et al; Writing Group of the Patient Navigation Research Program. Impact of patient navigation on timely cancer care: the Patient Navigation Research Program. J Natl Cancer Inst 2014; 106 (06) dju115
• 35 Poon EG, Wang SJ, Gandhi TK, Bates DW, Kuperman GJ. Design and implementation of a comprehensive outpatient Results Manager. J Biomed Inform 2003; 36 (1-2): 80-91
• 36 Lacson R, O'Connor SD, Andriole KP, Prevedello LM, Khorasani R. Automated critical test result notification system: architecture, design, and assessment of provider satisfaction. AJR Am J Roentgenol 2014; 203 (05) W491-6
• 37 Ortel TL, Arnold K, Beckman M. , et al. Design and implementation of a comprehensive surveillance system for venous thromboembolism in a defined region using electronic and manual approaches. Appl Clin Inform 2019; 10 (03) 552-562
• 38 Bates DW, Kuperman GJ, Wang S. , et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003; 10 (06) 523-530