Table 3 Inter-rater reliability for categorisation of appropriate and inappropriate referrals for MRI with six subcategories (n = 50)
Raters | Observed agreement (%) | Expected agreement (%) | Kappa (95% confidence interval) |
|---|---|---|---|
1:2 | 90.0 | 67.1 | 0.70 (0.40–0.92) |
1:3 | 88.0 | 65.8 | 0.65 (0.36–0.90) |
1:4 | 90.0 | 67.2 | 0.70 (0.40–0.92) |
1:5 | 94.0 | 70.3 | 0.80 (0.46–1.00) |
2:3 | 90.0 | 64.2 | 0.72 (0.45–0.94) |
2:4 | 92.0 | 65.6 | 0.77 (0.44–0.94) |
2:5 | 92.0 | 68.5 | 0.75 (0.47–0.94) |
3:4 | 98.0 | 64.3 | 0.94 (0.77–1.00) |
3:5 | 94.0 | 67.1 | 0.82 (0.56–1.00) |
4:5 | 96.0 | 68.6 | 0.87 (0.65–1.00) |
1:2:3:4:5 | 92.4 | 66.9 | 0.77 (0.58–0.91) |