PDF herunterladen
CC BY-NC-ND 4.0 · Journal of Academic Ophthalmology 2020; 12(02): e234-e238
DOI: 10.1055/s-0040-1718565
Research Article

Guiding Residency Program Educational Goals Using Institutional Keyword Reports from the Ophthalmic Knowledge Assessment Program Examination

Isdin Oke 
1   Department of Ophthalmology, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
,
Steven D. Ness
1   Department of Ophthalmology, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
,
Jean E. Ramsey
1   Department of Ophthalmology, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
,
Nicole H. Siegel
1   Department of Ophthalmology, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
,
Crandall E. Peeler
1   Department of Ophthalmology, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
› Institutsangaben
› Weitere Informationen
   Lizenzen und Reprints

Abstract

Introduction Residency programs receive an institutional keyword report following the annual Ophthalmic Knowledge Assessment Program (OKAP) examination containing the raw number of incorrectly answered questions. Programs would benefit from a method to compare relative performance between subspecialty sections. We propose a technique of normalizing the keyword report to determine relative subspecialty strengths and weaknesses in trainee performance.

Methods We retrospectively reviewed our institutional keyword reports from 2017 to 2019. We normalized the percentage of correctly answered questions for each postgraduate year (PGY) level by dividing the percent of correctly answered questions for each subspecialty by the percent correct across all subsections for that PGY level. We repeated this calculation for each PGY level in each subsection for each calendar year of analysis.

Results There was a statistically significant difference in mean performance between the subspecialty sections (p = 0.038). We found above average performance in the Uveitis and Ocular Inflammation section (95% confidence interval [CI]: 1.02–1.18) and high variability of performance in the Clinical Optics section (95% CI: 0.76–1.34).

Discussion The OKAP institutional keyword reports are extremely valuable for residency program self-evaluation. Performance normalized for PGY level and test year can reveal insightful trends into the relative strengths and weaknesses of trainee knowledge and guide data-driven curriculum improvement.

Keywords

Ophthalmic Knowledge Assessment Program - institution keyword reports - residency program - didactics - education - curriculum


Publikationsverlauf

Eingereicht: 15. Juni 2020

Angenommen: 31. August 2020

Artikel online veröffentlicht:
04. November 2020

© 2020. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).

Thieme Medical Publishers
333 Seventh Avenue, New York, NY 10001, USA.

 

  • References

  • 1 Liesegang TJ. New directions for the Ophthalmic Knowledge Assessment Program (OKAP) examination. Ophthalmology 1994; 101 (01) 194-198
    CrossrefPubMedSuche in Google Scholar
  • 2 O'Day DM. Examinations and ophthalmic education. Ophthalmology 2012; 119 (10) 1947-1948
    CrossrefPubMedSuche in Google Scholar
  • 3 Zafar S, Wang X, Srikumaran D. et al. Resident and program characteristics that impact performance on the Ophthalmic Knowledge Assessment Program (OKAP). BMC Med Educ 2019; 19 (01) 190
    CrossrefPubMedSuche in Google Scholar
  • 4 Chen PP. Resident OKAP performance. Ophthalmology 2012; 119 (03) 656
    CrossrefPubMedSuche in Google Scholar
  • 5 Rapuano C, Stout T. Ophthalmic Knowledge Assessment Program Committee. OKAP User's Guide. . Available at: https://www.aao.org/okap-exam. 2019. Accessed September 15, 2020
    PubMed
  • 6 Oke I, Siegel NH, Peeler CE. et al. Completing the basic and clinical science course as a first-year ophthalmology resident. J Acad Ophthalmol 2019; 11: e54-e58
    Thieme ConnectPubMedSuche in Google Scholar
  • 7 Arnold A. Developing the educational milestones for ophthalmology. J Grad Med Educ 2014; 6 (01) (Suppl. 01) 144-145
    CrossrefPubMedSuche in Google Scholar
  • 8 Lee AG, Oetting TA, Blomquist PH. et al. A multicenter analysis of the ophthalmic knowledge assessment program and American Board of Ophthalmology written qualifying examination performance. Ophthalmology 2012; 119 (10) 1949-1953
    CrossrefPubMedSuche in Google Scholar
  • 9 Carey A, Drucker M. Standardized Training Examinations among Ophthalmology Residents and the American Board of Ophthalmology Written Qualifying Examination First Attempt: The Morsani College of Medicine Experience. Journal of Academic Ophthalmology 2014; 07: e008-e012
    Thieme ConnectPubMedSuche in Google Scholar
  • 10 Kempton JE, Shields MB, Afshari NA, Dou W, Adelman RA. Fellow selection criteria. Ophthalmology 2009; 116 (05) 1020-1020.e4
    CrossrefPubMedSuche in Google Scholar
  • 11 Johnson GA, Bloom JN, Szczotka-Flynn L, Zauner D, Tomsak RL. A comparative study of resident performance on standardized training examinations and the American Board of Ophthalmology Written Examination. Ophthalmology 2010; 117 (12) 2435-2439
    CrossrefPubMedSuche in Google Scholar