Challenges in Adapting Existing Clinical Natural Language Processing Systems to Multiple, Diverse Health Care Settings

Publication Name: 
Journal of the American Medical Informatics Association
Publication Authors: 
Carrell DS, Schoen RE, Leffler DA, Morris M, Rose S et al
Date of Publication: 
Apr 2017

Abstract

OBJECTIVE:

Widespread application of clinical natural language processing (NLP) systems requires taking existing NLP systems and adapting them to diverse and heterogeneous settings. We describe the challenges faced and lessons learned in adapting an existing NLP system for measuring colonoscopy quality.

MATERIALS AND METHODS:

Colonoscopy and pathology reports from 4 settings during 2013-2015, varying by geographic location, practice type, compensation structure, and electronic health record.

RESULTS:

Though successful, adaptation required considerably more time and effort than anticipated. Typical NLP challenges in assembling corpora, diverse report structures, and idiosyncratic linguistic content were greatly magnified.

DISCUSSION:

Strategies for addressing adaptation challenges include assessing site-specific diversity, setting realistic timelines, leveraging local electronic health record expertise, and undertaking extensive iterative development. More research is needed on how to make it easier to adapt NLP systems to new clinical settings.

CONCLUSIONS:

A key challenge in widespread application of NLP is adapting existing systems to new clinical settings.

KEYWORDS:

cancer screening; data collection; electronic health records; information dissemination; natural language processing

View the Article