RSS-Feed abonnieren
![](/products/assets/desktop/img/oa-logo.png)
DOI: 10.1055/a-2091-1162
Extracting Pain Care Quality Indicators from U.S. Veterans Health Administration Chiropractic Care Using Natural Language Processing
FundingThis study was funded by the Health Services Research and Development, (grant numbers: CIN-13-407 and IIR-12-118) and U.S. Department of Health and Human Services, National Institutes of Health, National Center for Complementary and Integrative Health, (grant number: K08AT011570), and NCMIC Foundation.![](https://www.thieme-connect.de/media/10.1055-s-00035026/202303/lookinside/thumbnails/10-1055-a-2091-1162_202212ra0342-1.jpg)
Abstract
Background Musculoskeletal pain is common in the Veterans Health Administration (VHA), and there is growing national use of chiropractic services within the VHA. Rapid expansion requires scalable and autonomous solutions, such as natural language processing (NLP), to monitor care quality. Previous work has defined indicators of pain care quality that represent essential elements of guideline-concordant, comprehensive pain assessment, treatment planning, and reassessment.
Objective Our purpose was to identify pain care quality indicators and assess patterns across different clinic visit types using NLP on VHA chiropractic clinic documentation.
Methods Notes from ambulatory or in-hospital chiropractic care visits from October 1, 2018 to September 30, 2019 for patients in the Women Veterans Cohort Study were included in the corpus, with visits identified as consultation visits and/or evaluation and management (E&M) visits. Descriptive statistics of pain care quality indicator classes were calculated and compared across visit types.
Results There were 11,752 patients who received any chiropractic care during FY2019, with 63,812 notes included in the corpus. Consultation notes had more than twice the total number of annotations per note (87.9) as follow-up visit notes (34.7). The mean number of total classes documented per note across the entire corpus was 9.4 (standard deviation [SD] = 1.5). More total indicator classes were documented during consultation visits with (mean = 14.8, SD = 0.9) or without E&M (mean = 13.9, SD = 1.2) compared to follow-up visits with (mean = 9.1, SD = 1.4) or without E&M (mean = 8.6, SD = 1.5). Co-occurrence of pain care quality indicators describing pain assessment was high.
Conclusion VHA chiropractors frequently document pain care quality indicators, identifiable using NLP, with variability across different visit types.
Availability of Data and Materials
To maximize protection security of Veterans' data while making these data available to researchers, the U.S. Department of Veterans Affairs (VA) developed the VA Informatics and Computing Infrastructure (VINCI). VA researchers must log onto VINCI via a secure gateway or virtual private network connection (VPN) and use a virtual workspace on VINCI to access and analyze VA data. By VA Office of Research and Development policy, VINCI does not allow the transfer of any patient-level data out of its secure environment without special permission. Researchers who are not VA employees must be vetted and receive “without compensation” (WOC) employee status to gain access to VINCI. All analyses performed for this study took place on the VINCI platform. For questions about data access, contact study lead, Dr. Brian C. Coleman (Brian.Coleman2@va.gov) or the VA Office of Research and Development (VHACOORDRegulatory@va.gov).
Protection of Human and Animal Subjects
The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects, and was reviewed and approved by the VA Connecticut Healthcare System Institutional Review Board.
Publikationsverlauf
Eingereicht: 05. Januar 2023
Angenommen: 27. April 2023
Accepted Manuscript online:
10. Mai 2023
Artikel online veröffentlicht:
02. August 2023
© 2023. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Hoy D, March L, Brooks P. et al. The global burden of low back pain: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis 2014; 73 (06) 968-974
- 2 Hurwitz EL, Randhawa K, Yu H, Côté P, Haldeman S. The Global Spine Care Initiative: a summary of the global burden of low back and neck pain studies. Eur Spine J 2018; 27 (Suppl. 06) 796-801
- 3 Blyth FM, Briggs AM, Schneider CH, Hoy DG, March LM. The global burden of musculoskeletal pain-where to from here?. Am J Public Health 2019; 109 (01) 35-40
- 4 St Sauver JL, Warner DO, Yawn BP. et al. Why patients visit their doctors: assessing the most prevalent conditions in a defined American population. Mayo Clin Proc 2013; 88 (01) 56-67
- 5 Goulet JL, Kerns RD, Bair M. et al. The musculoskeletal diagnosis cohort: examining pain and pain care among Veterans. Pain 2016; 157 (08) 1696-1703
- 6 US Department. of Veterans Affairs. VA Directive 2009-053 - Pain Management. Washington, DC; US Department of Veterans Affairs; 2009
- 7 Kerns RD, Philip EJ, Lee AW, Rosenberger PH. Implementation of the Veterans health administration national pain management strategy. Transl Behav Med 2011; 1 (04) 635-643
- 8 Kligler B, Bair MJ, Banerjea R. et al. Clinical policy recommendations from the VHA state-of-the-art conference on non-pharmacological approaches to chronic musculoskeletal pain. J Gen Intern Med 2018; 33 (1, suppl 1): 16-23
- 9 Lisi AJ, Salsbury SA, Hawk C. et al. Chiropractic integrated care pathway for low back pain in Veterans: results of a delphi consensus process. J Manipulative Physiol Ther 2018; 41 (02) 137-148
- 10 Lisi AJ, Brandt CA. Trends in the use and characteristics of chiropractic services in the Department of Veterans Affairs. J Manipulative Physiol Ther 2016; 39 (05) 381-386
- 11 Military Conssstruction, Veterans Affairs, and Related Agencies Appropriations Act of 2018, Pub. L. 115-141, 132 Stat. 348 (March 23, 2018)
- 12 US Department. of Veterans Affairs. VA Directive 2018-1210 - Chiropractic Care. Washington, DC: US Dept. of Veterans Affairs; 2018
- 13 Ohno-Machado L. Realizing the full potential of electronic health records: the role of natural language processing. J Am Med Inform Assoc 2011; 18 (05) 539
- 14 Nadkarni PM, Ohno-Machado L, Chapman WW. Natural language processing: an introduction. J Am Med Inform Assoc 2011; 18 (05) 544-551
- 15 Rousseau JF, Ip IK, Raja AS. et al. Can automated retrieval of data from emergency department physician notes enhance the imaging order entry process?. Appl Clin Inform 2019; 10 (02) 189-198
- 16 Sevenster M, Buurman J, Liu P, Peters JF, Chang PJ. Natural language processing techniques for extracting and categorizing finding measurements in narrative radiology reports. Appl Clin Inform 2015; 6 (03) 600-110
- 17 Nawab K, Ramsey G, Schreiber R. Natural language processing to extract meaningful information from patient experience feedback. Appl Clin Inform 2020; 11 (02) 242-252
- 18 Jones BE, South BR, Shao Y. et al. Development and validation of a natural language processing tool to identify patients treated for pneumonia across VA emergency departments. Appl Clin Inform 2018; 9 (01) 122-128
- 19 Dorflinger LM, Gilliam WP, Lee AW, Kerns RD. Development and application of an electronic health record information extraction tool to assess quality of pain management in primary care. Transl Behav Med 2014; 4 (02) 184-189
- 20 Luther SL, Finch DK, Bouayad L. et al. Measuring pain care quality in the Veterans Health Administration primary care setting. Pain 2022; 163 (06) e715 –e724
- 21 Fodeh SJ, Finch D, Bouayad L. et al. Classifying clinical notes with pain assessment using machine learning. Med Biol Eng Comput 2018; 56 (07) 1285-1292
- 22 Gaffey AE, Burg MM, Rosman L. et al. Baseline characteristics from the Women Veterans Cohort Study: gender differences and similarities in health and healthcare utilization. J Womens Health (Larchmt) 2021; 30 (07) 944-955
- 23 von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol 2008; 61 (04) 344-349
- 24 Roytman GR, Coleman BC, Corcoran KL, Goertz CM, Long CR, Lisi AJ. Changes in the use of telehealth and face-to-face chiropractic care in the Department of Veterans Affairs before and after the COVID-19 pandemic. J Manipulative Physiol Ther 2021; 44 (07) 584-590
- 25 Fang Q, Nguyen D, Oberski DL. Evaluating the construct validity of text embeddings with application to survey questions. EPJ Data Sci 2022; 11 (01) 39
- 26 Hawk C, Whalen W, Farabaugh RJ. et al. Best practices for chiropractic management of patients with chronic musculoskeletal pain: a clinical practice guideline. J Altern Complement Med 2020; 26 (10) 884-901
- 27 Ramsey C, Dziura J, Justice AC. et al. Incidence of mental health diagnoses in Veterans of Operations Iraqi Freedom, Enduring Freedom, and New Dawn, 2001-2014. Am J Public Health 2017; 107 (02) 329-335
- 28 Seal KH, Metzler TJ, Gima KS, Bertenthal D, Maguen S, Marmar CR. Trends and risk factors for mental health diagnoses among Iraq and Afghanistan Veterans using Department of Veterans Affairs health care, 2002-2008. Am J Public Health 2009; 99 (09) 1651-1658
- 29 Coleman BC, Corcoran KL, DeRycke EC. et al. Factors associated with posttraumatic stress disorder among Veterans of recent wars receiving Veterans affairs chiropractic care. J Manipulative Physiol Ther 2020; 43 (08) 753-759
- 30 Burks K, Shields J, Evans J, Plumley J, Gerlach J, Flesher S. A systematic review of outpatient billing practices. SAGE Open Med 2022; 10: 20 503121221099021
- 31 King MS, Sharp L, Lipsky MS. Accuracy of CPT evaluation and management coding by family physicians. J Am Board Fam Pract 2001; 14 (03) 184-192
- 32 Becker WC, Dorflinger L, Edmond SN, Islam L, Heapy AA, Fraenkel L. Barriers and facilitators to use of non-pharmacological treatments in chronic pain. BMC Fam Pract 2017; 18 (01) 41