Subscribe to RSS
DOI: 10.1055/s-0043-1771034
Ophthalmology Residency Program Director Survey on Pass/Fail U.S. Medical Licensing Exam Step 1 Scoring
Funding This work was supported by the Research to Prevent Blindness unrestricted grant awarded to Department of Ophthalmology and Visual Sciences at University of Alabama at Birmingham.
Abstract
Background Beginning January 26, 2022, the U.S. Medical Licensing Exam (USMLE) Step 1 changed from a numerical score to pass/fail (P/F). The purpose of this study was to determine the perspective of ophthalmology program directors regarding this change in evaluating applicants.
Methods After institutional review board approval, a survey was sent out to program directors of all 125 ophthalmology programs accredited by the Accreditation Council for Graduate Medical Education. Survey questions asked for program demographics, the utility of USMLE Step 1 and 2 Clinical Knowledge scores in assessing applicants, and the importance of 16 different applicant metrics before and after Step 1 becomes P/F. The metrics examined were: letters of recommendation; clerkship grades; class ranking; Alpha Omega Alpha Membership; Gold Humanism Honor Society Membership; Dean's Letter; involvement and leadership; personal statement; number of abstracts, presentations, and publications; mean number of research experiences in the specialty; Step 2 Clinical Knowledge score; volunteering; preclinical grades; away rotation in the specialty; the applicant having another graduate degree; and graduation from a top 40 National Institutes of Health-funded program. Data were analyzed using nonoverlapping 95% confidence intervals.
Results The survey was completed by 50 (40%) program directors. Sixty-eight percent of respondents stated a student's ranking would be considered more after USMLE Step 1 scores become P/F, and 60% stated medical schools should share clerkship shelf exam scores with residency programs. There were no significant differences in program directors' rankings of applicant metrics following the transition to P/F Step 1.
Conclusion Based on our data, program directors will likely not place a greater emphasis on Step 2 scores, despite it being the only remaining objective measure for all applicants following the switch to a P/F Step 1. Nevertheless, program directors expressed an interest in receiving other objective measures, such as shelf exam scores and class ranking, as part of the application process. Notably, we found no significant changes in the rankings of various applicant metrics before and after the transition to P/F Step 1, indicating that the metrics that were important to program directors prior to the change remain just as critical in the new era of admissions.
Publication History
Received: 13 January 2023
Accepted: 12 June 2023
Article published online:
14 November 2023
© 2023. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA
-
References
- 1 Loh AR, Joseph D, Keenan JD, Lietman TM, Naseri A. Predictors of matching in an ophthalmology residency program. Ophthalmology 2013; 120 (04) 865-870
- 2 Chaudhry HJ, Katsufrakis PJ, Tallia AF. The USMLE Step 1 Decision: An Opportunity for Medical Education and Training. JAMA 2020; 323 (20) 2017-2018
- 3 McGaghie WC, Cohen ER, Wayne DB. Are United States medical licensing exam Step 1 and 2 scores valid measures for postgraduate medical residency selection decisions?. Acad Med 2011; 86 (01) 48-52
- 4 Wagner JG, Schneberk T, Zobrist M. et al. What predicts performance? A multicenter study examining the association between resident performance, rank list position, and United States medical licensing examination Step 1 scores. J Emerg Med 2017; 52 (03) 332-340
- 5 Kay C, Jackson JL, Frank M. The relationship between internal medicine residency graduate performance on the ABIM certifying examination, yearly in-service training examinations, and the USMLE Step 1 examination. Acad Med 2015; 90 (01) 100-104
- 6 Harmouche E, Goyal N, Pinawin A, Nagarwala J, Bhat R. USMLE scores predict success in ABEM initial certification: a multicenter study. West J Emerg Med 2017; 18 (03) 544-549
- 7 Sharma A, Schauer DP, Kelleher M, Kinnear B, Sall D, Warm E. USMLE Step 2 CK: best predictor of multimodal performance in an internal medicine residency. J Grad Med Educ 2019; 11 (04) 412-419
- 8 Shirkhodaie C, Avila S, Seidel H, Gibbons RD, Arora VM, Farnan JM. The association between USMLE Step 2 Clinical Knowledge scores and residency performance: a systematic review and meta-analysis. Acad Med 2023; 98 (02) 264-273
- 9 Summary Report and Preliminary Recommendations from the Invitational Conference on USMLE Scoring (InCUS), March 11–12, 2019. Accessed December 12, 2022. https://www.usmle.org/sites/default/files/2021-08/incus_summary_report.pdf
- 10 Patel OU, Haynes WK, Burge KG. et al. Results of a national survey of program directors' perspectives on a pass/fail US medical licensing examination Step 1. JAMA Netw Open 2022; 5 (06) e2219212
- 11 Markle JC, Ahmed H, Pandya K. et al. Transparency in the ophthalmology residency match: background, study, and implications. Cureus 2021; 13 (11) e19826