Stanford University School of Medicine, Stanford, CA
Rebecca A. Bromley-Dulfano, Mary Beth Landrum, Gabriel A. Brooks, Alexi A. Wright, Nancy Lynn Keating
Background: Identifying reliable measures that distinguish care quality at the medical oncology practice level is crucial to ensuring delivery of high-value cancer care, particularly as alternative payment models in oncology become more frequent. We assessed reliability of several claims-based quality measures across oncology practices. Methods: Using 100% Medicare claims data for fee-for-service beneficiaries with cancer, we identified 6-month chemotherapy episodes starting in four 6-month performance periods (PPs) from July 2017 to June 2019. We assessed quality measures of acute care utilization among all episodes and end-of-life (EOL) care among decedents who died during or by 90 days of the episode’s end. We estimated practice-level adjusted rates from hierarchical linear models with practice-level random effects, PP fixed effects, and clinical/demographic controls. We documented intraclass correlation (ICC, variation attributed to practice) and calculated reliability (reproducibility) for the most recent 6-month PP for each measure from the between-measure variance, within-measure variance, and number of episodes per practice, excluding practices with <20 episodes. We considered reliability ≥70% (ie, <30% of variation in practices’ performance due to chance instead of true quality differences) to be adequate. Results: Among 443,865 patients from 2,307 practices, 90% were >65 years old, 84% were White, 31% had lung or breast cancer. The median (IQR) number of patients in practices with ≥20 episodes was 59 (17-195). Most ICCs were low, suggesting limited variation across practices (Table). All the utilization and EOL measures had a practice-level reliability of <70% for the average-sized practice (Table). Most measures demonstrated little variation over time (<2 percentage point difference over 4 PPs). Conclusions: None of the measures studied were reliable for average-sized practices, suggesting limited ability to distinguish care quality across practices treating fee-for-service Medicare patients within a single PP, except among larger practices. Several measures would be reliable for many practices over an evaluation period of 1-2 years, with a tradeoff of using less current data to monitor performance.
Measure | ICC | Average N Episodes/Practice per PP | Reliability at Average Practice Size | N Episodes/Practice for ≥70% Reliability |
---|---|---|---|---|
Utilizationa | ||||
% with ED visit during episode | 0.0066 | 192 | 56.0% | 351 |
% with hospitalization during episode | 0.0031 | 192 | 37.7% | 738 |
EOLb | ||||
% with ICU stay in last 30 day of life | 0.0203 | 29 | 37.5% | 113 |
% enrolled in hospice ≥3 days before death | 0.0155 | 29 | 31.4% | 149 |
% with hospitalization in last 30 days of lifea | 0.0070 | 29 | 17.0% | 331 |
% with ≥2 ED visits in last 30 days of life | 0.0052 | 29 | 13.1% | 450 |
% with chemotherapy in last 14 days of life | 0.0034 | 29 | 9.1% | 678 |
aMeasures from Oncology Care Model.
bMeasures from National Quality Forum.
Disclaimer
This material on this page is ©2024 American Society of Clinical Oncology, all rights reserved. Licensing available upon request. For more information, please contact licensing@asco.org
Abstract Disclosures
2024 ASCO Annual Meeting
First Author: Divya Deepak
2024 ASCO Quality Care Symposium
First Author: Jody S. Garey
2023 ASCO Quality Care Symposium
First Author: Youngmin Kwon
2023 ASCO Annual Meeting
First Author: Chipo Natasha Kwendakwema