Natural language processing-optimized case selection for real-world evidence studies.

Authors

null

Jacob Koskimaki

CancerLinQ, Alexandria, VA

Jacob Koskimaki , Jenny Hu , Yiduo Zhang , Jose Mena , Nehanda Jones , Elizabeth Lipschultz , Vivek Prabhakar Vaidya , Gabriel Altay , Vance Andrei Erese , Krishna Kumar Swaminathan , Emma Mendonca , Tarun Dutt , Kuldeep Singh , Tian King , Vinay Phani Santosh Lakkimsetty , Hussein Al-Olimat , Brittany Manning , George Anthony Komatsoulis , Simon Chu , Jeff Ottens

Organizations

CancerLinQ, Alexandria, VA, AstraZeneca Pharmaceuticals LP, Gaithersburg, MD, AstraZeneca Pharmaceuticals LP, Wilmington, DE, CancerLinQ, LLC, Alexandria, VA, ConcertAI, Bengaluru, India, Tempus Labs, Inc., Chicago, IL, ConcertAI, Bangalore, India, Concert AI, Bangalore, India, Tempus Labs, Chicago, IL, American Society of Clinical Oncology’s (ASCO) CancerLinQ, Alexandria, VA

Research Funding

Pharmaceutical/Biotech Company

Background: Much information describing a patient’s cancer treatment remains in unstructured text in electronic health records and is not recorded in discrete data fields. Accurate data completeness is essential for quality care improvement and research studies on de-identified patient records. Accessing this high-value content often requires manual and extensive curation review. Methods: AstraZeneca, CancerLinQ, ConcertAI, and Tempus have developed a natural language processing (NLP)-assisted process to improve clinical cohort selection for targeted curation efforts. Hybrid, machine-learning model development included text classification, named entity recognition, relation extraction and false positive removal. A subset of nearly 60,000 lung cancer cases were included from the CancerLinQ database, comprised of multiple source EHR systems. NLP models extracted EGFR status, stage, histology, radiation therapy, surgical resection and oral medications. Based on the results, cases were selected for additional manual curation, where curators confirmed findings of the NLP-processed data. Results: NLP methods improved cohort identification. Successfully returned cases using the NLP method ranged from 75.2% to 96.5% over more general case selection criteria based on limited structured data. For all cohorts combined, 84.2% of the cases sent out for NLP curation were returned with curated content (Table). Each cohort contained a range of NLP-derived elements for curators to further review. In comparison, more general case selection criteria yielded a total of 3,878 cases returned out of 41,186 lung cancer cases sent for curation, for a success rate of only 9.6%. Conclusions: NLP-driven case selection of six distinct, complex lung cohorts resulted in an order of magnitude improvement in eligibility over candidate selection using structured EHR data alone. This study demonstrates NLP-assisted approaches can significantly improve efficiency in curating unstructured health data.

NLP-assisted cohort selection for the six pre-specified lung cancer cohorts.
CohortCohort DescriptionNumber of cases available from NLP-assisted identification methodsNumber of cases sent to Tempus and ConcertAI for curationNumber of cases returned to CancerLinQ with curated contentPercent of successfully curated cases
1ANSCLC, stage I, II, III, EGFR+, complete resection40840834183.6%
1BNSCLC, non-squamous, stage I, II, III, EGFR wild type/unknown, complete resection43131500128585.7%
2ANSCLC, stage III, unresectable, curative radiation to the chest total dose >= 50 Gy, did receive Imfinzi85262046675.2%
2BNSCLC, stage III, unresectable, curative radiation to the chest total dose >= 50 Gy, did not receive Imfinzi305075072496.5%
3SCLC, received Imfinzi or Tecentriq55950040280.4%
4NSCLC, received Tagrisso as first line treatment97181264779.7%
Total:1015345903865

Disclaimer

This material on this page is ©2024 American Society of Clinical Oncology, all rights reserved. Licensing available upon request. For more information, please contact licensing@asco.org

Abstract Details

Meeting

2022 ASCO Annual Meeting

Session Type

Poster Session

Session Title

Care Delivery and Regulatory Policy

Track

Care Delivery and Quality Care

Sub Track

Clinical Informatics/Advanced Algorithms/Machine Learning

Citation

J Clin Oncol 40, 2022 (suppl 16; abstr 1556)

DOI

10.1200/JCO.2022.40.16_suppl.1556

Abstract #

1556

Poster Bd #

149

Abstract Disclosures