Evaluating the Portability of an NLP System for Processing Echocardiograms: A Retrospective, Multi-site Observational Study

Prakash Adekkanattu, Guoqian Jiang, Yuan Luo, Paul R. Kingsbury, Zhenxing Xu, Luke V. Rasmussen, Jennifer A. Pacheco, Richard C. Kiefer, Daniel J. Stone, Pascal S. Brandt, Liang Yao, Yizhen Zhong, Yu Deng, Fei Wang, Jessica S. Ancker, Thomas R. Campion, Jyotishman Pathak

Research output: Contribution to journalArticle

Abstract

While natural language processing (NLP) of unstructured clinical narratives holds the potential for patient care and clinical research, portability of NLP approaches across multiple sites remains a major challenge. This study investigated the portability of an NLP system developed initially at the Department of Veterans Affairs (VA) to extract 27 key cardiac concepts from free-text or semi-structured echocardiograms from three academic edical centers: Weill Cornell Medicine, Mayo Clinic and Northwestern Medicine. While the NLP system showed high precision and recall easurements for four target concepts (aortic valve regurgitation, left atrium size at end systole, mitral valve regurgitation, tricuspid valve regurgitation) across all sites, we found moderate or poor results for the remaining concepts and the NLP system performance varied between individual sites.

Original languageEnglish (US)
Pages (from-to)190-199
Number of pages10
JournalAMIA ... Annual Symposium proceedings. AMIA Symposium
Volume2019
StatePublished - Jan 1 2019

ASJC Scopus subject areas

  • Medicine(all)

Fingerprint Dive into the research topics of 'Evaluating the Portability of an NLP System for Processing Echocardiograms: A Retrospective, Multi-site Observational Study'. Together they form a unique fingerprint.

  • Cite this

    Adekkanattu, P., Jiang, G., Luo, Y., Kingsbury, P. R., Xu, Z., Rasmussen, L. V., Pacheco, J. A., Kiefer, R. C., Stone, D. J., Brandt, P. S., Yao, L., Zhong, Y., Deng, Y., Wang, F., Ancker, J. S., Campion, T. R., & Pathak, J. (2019). Evaluating the Portability of an NLP System for Processing Echocardiograms: A Retrospective, Multi-site Observational Study. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2019, 190-199.