Skip to main content

Table 2 Performance measures of administrative data (Ontario Health Insurance Program + Ontario Drug Benefit Program) in identifying influenza vaccination status, using the Canadian Community Health Survey as reference standard, stratified by respondent characteristics

From: Validation of influenza vaccination status using health administrative databases by integrating pharmacy claims and medical billing databases in Ontario, Canada

Characteristics

True Positive

False Positive

True Negative

False Negative

Sensitivity (95% CI)

Specificity (95% CI)

PPV

(95% CI)

NPV

(95% CI)

Total (n = 31,390)

Total Vaccinated in CCHS = 13,358 (43%)

8034

274

17,758

5324

60.1%

(59.3%−61.0%)

98.5%

(98.3%−98.7%)

96.7%

(96.3%−97.1%)

76.9%

(76.4%−77.5%)

Canadian Community Health Survey Year

 2013 (n = 16,229)

Total Vaccinated in CCHS = 6,625 (41%)

3795

146

9458

2830

57.3% (56.1%−58.5%)

98.5% (98.2%−98.7%)

96.3% (95.7%−96.9%)

77.0% (76.2%−77.7%)

 2014 (n = 15,161)

Total Vaccinated in CCHS = 6,733(44%)

4239

128

8300

2494

63.0% (61.8%−64.1%)

98.5% (98.2%−98.7%)

97.1% (96.5%−97.6%)

76.9% (76.1%−77.7%)

Sex

 Female (n = 17,267)

Total Vaccinated in CCHS = 7,824 (45%)

4728

143

9300

3096

60.4%

(59.3%−61.5%)

98.5% (98.2%−98.7%)

97.1% (96.6%−97.5%)

75.0% (74.3%−75.8%)

 Male (n = 14,123)

Total Vaccinated in CCHS = 5,534 (39%)

3306

131

8458

2228

59.7% (58.4%−61.0%)

98.5% (98.2%−98.7%)

96.2% (95.5%−96.8%)

79.2% (78.4%−79.9%)

Age group

 12–17 (n = 2,486)) Total Vaccinated in CCHS = 694 (28%)

224

31

1761

470

32.3% (28.8%−35.9%)

98.3% (97.6%−98.8%)

87.8% (83.2%−91.6%)

78.9% (77.2%−80.6%)

 18–49 (n = 11,405)) Total Vaccinated in CCHS = 2,595 (23%)

1121

78

8732

1474

43.2% (41.3%−45.1%)

99.1% (98.9%−99.3%)

93.5% (92.0%−94.8%)

85.6% (84.9%−86.2%)

 50–64 (n = 8,384)) Total Vaccinated in CCHS = 3,559 (42%)

1959

68

4757

1600

55.0% (53.4%−56.7%)

98.6% (98.2%−98.9%)

96.7% (95.8%−97.4%)

74.8% (73.7%−75.9%)

 < 65 (n = 22,275)

Total Vaccinated in CCHS = 6,848 (31%)

3304

177

15,250

3544

48.3% (47.1%−49.4%)

98.9% (98.7%−99.0%)

94.9% (94.1%−95.6%)

81.1% (80.6%−81.7%)

 65 + (n = 9,115)

Total Vaccinated in CCHS = 6,510 (71%)

4730

97

2508

1780

72.7% (71.6%−73.7%)

96.3% (95.5%−97.0%)

98.0% (97.6%−98.4%)

58.5% (57.0%−60.0%)

Residence

 Urban area of residence (n = 24,708)

Total Vaccinated in CCHS = 10,503 (43%)

6435

236

13,969

4068

61.3% (60.3%−62.2%)

98.3% (98.1%−98.5%)

96.5% (97.0%−96.9%)

77.5% (76.8%−78.1%)

 Rural area of residence (n = 6,661)

Total Vaccinated in CCHS = 2,851(43%)

1598

38

3772

1253

56.1% (54.2%−57.9%)

99.0% (98.6%−99.3%)

97.7% (96.8%−98.4%)

75.1% (73.8%−76.3%)

Has a Regular Doctor

 Yes (n = 29,254)

Total Vaccinated in CCHS = 12,919 (44%)

7894

262

16,073

5025

61.1% (60.3%−62.0%)

98.4% (98.2%−98.6%)

96.8% (96.4%−97.2%)

76.2% (75.6%−76.8%)

 No (n = 2,100)

Total Vaccinated in CCHS = 429 (20%)

137

12

1659

292

31.9% (27.5%−36.6%)

99.3% (98.8%−99.6%)

92.0% (86.4%−95.8%)

85.0% (83.4%−86.6%)

Risk factors (comorbidities) for influenza complication

 No Risk Factor (n = 14,446)

Total Vaccinated in CCHS = 3,968 (27%)

1852

107

10,371

2116

46.7% (45.1%−48.2%)

99.0% (98.8%−99.2%)

94.5% (93.4%−95.5%)

83.1% (82.4%−83.7%)

 Any Risk Factor (n = 16,944)

Total Vaccinated in CCHS = 9,390 (55%)

6182

167

7387

3208

65.8% (64.9%−66.8%)

97.8% (97.4%−98.1%)

97.4% (97.0%−97.8%)

69.7% (68.8%−70.6%)

 Anemia (n = 1,696)

Total Vaccinated in CCHS = 1,051 (62%)

719

17

628

332

68.4% (65.5%−71.2%)

97.4% (95.8%−98.5%)

97.7% (96.3%−98.7%)

65.4% (62.3%−68.4%)

 Arrhythmia (n = 1,226)

Total Vaccinated in CCHS = 902 (74%)

637

9

315

265

70.6% (67.5%−73.6%)

97.2% (94.8%−98.7%)

98.6% (97.4%−99.4%)

54.3% (50.2%−58.4%)

 Asthma (n = 4,622)

Total Vaccinated in CCHS = 2,091 (45%)

1271

52

2479

820

60.8% (58.7%−62.9%)

98.0% (97.3%−98.5%)

96.1% (94.9%−97.1%)

75.1% (73.6%−76.6%)

 Cancer (n = 2,298)

Total Vaccinated in CCHS = 1,580 (69%)

1112

21

697

468

70.4% (68.1%−72.6%)

97.1% (95.6%−98.2%)

98.2% (97.2%−98.9%)

59.8% (57.0%−62.7%)

 Cardiovascular Disease: Arrhythmia/HTN/IHD/MI/Stroke (n = 3,580)

Total Vaccinated in CCHS = 2,520 (70%)

1761

30

1030

759

69.9% (68.1%−71.7%)

97.2% (96.0%−98.1%)

98.3% (97.6%−98.9%)

57.6% (55.3%−59.9%)

 COPD (n = 3,293)

Total Vaccinated in CCHS = 2,142 (65%)

1470

27

1124

672

68.6% (66.6%−70.6%)

97.7% (96.6%−98.5%)

98.2% (97.4%−98.8%)

62.6% (60.3%−64.8%)

 Dementia (n = 264)

Total Vaccinated in CCHS = 207 (78%)

146

10

47

61

70.5% (63.8%−76.7%)

82.5% (70.1%−91.3%)

93.6% (88.5%−96.9%)

43.5% (34.0%−53.4%)

 Hypertension (n = 10,122)

Total Vaccinated in CCHS = 6,580 (65%)

4566

99

3443

2014

69.4% (68.3%−70.5%)

97.2% (96.6%−97.7%)

97.9% (97.4%−98.3%)

63.1% (61.8%−64.4%)

 Immunocompromised (n = 490)

Total Vaccinated in CCHS = 370 (76%)

274

6

114

96

74.1% (69.3%−78.5%)

95.0% (89.4%−98.1%)

97.9% (95.4%−99.2%)

54.3% (47.3%−61.2%)

 Ischemic heart disease (n = 2,308)

Total Vaccinated in CCHS = 1,643 (71%)

1147

19

646

496

69.8% (67.5%−72.0%)

97.1% (95.6%−98.3%)

98.37% (97.5%−99.0%)

56.6% (53.6%−59.5%)

 Myocardial Infarction (n = 1,024)

Total Vaccinated in CCHS = 722 (71%)

510

8

294

212

70.6% (67.2%−73.9%)

97.4% (94.9%−98.9%)

98.5% (97.0%−99.3%)

58.1% (53.7%−62.4%)

 Stroke (n = 581)

Total Vaccinated in CCHS = 403 (69%)

287

6

172

116

71.2% (66.5%−75.6%)

96.6% (92.8%−98.8%)

98.0% (95.6%−99.2%)

59.7% (53.8%−65.4%)