Measuring multimorbidity series. An overlooked complexity - Comparison of self-report vs. administrative data in community-living adults: Paper 3. Agreement across data sources and implications for estimating associations with health service use

Abstract

Objective: The objective of this study is to describe agreement between administrative and self-report data on the number and type of chronic conditions (CCs) and determine whether associations between CC count and health service use differ by data source.

Study design and setting: We linked Canadian Community Health Survey and administrative data for a cohort of adults aged 45+ years in Ontario and identified 12 CCs from both data sources. Agreement was described by count and constituent CCs. We estimated associations between CC count (self-report and administrative data) and health service use (administrative data only) over 1 year.

Results: Among 71,317 adults, 26.9% showed agreement on both count and constituent CCs but agreement declined with increasing CCs. Health service use increased with CC count but the association was stronger when CCs were measured with administrative data. For example, when measured with administrative data, the odds of a general practitioner visit for 5+ CCs vs. none was 20.3 (95% CI 20.0-20.5) but when using self-report data, the estimate was 8.0 (95% CI 7.8-8.2).

Conclusion: Agreement on the number of CCs was low and resulted in different estimates on the association with health service use, illustrating the challenges in CC measurement and the ability to interpret the effects on outcomes.

Keywords: Canadian Community Health Survey; Health administrative data; Hospitalization; Multimorbidity; Multiple chronic conditions; Physician visits; Self-report data.