Raters | Observed agreement (%) | Expected agreement (%) | Kappa (95% confidence interval) |
---|---|---|---|
1:2 | 90.0 | 67.5 | 0.68 (0.41–0.94) |
1:3 | 88.0 | 67.9 | 0.63 (0.36–0.90) |
1:4 | 90.0 | 69.2 | 0.68 (0.41–0.94) |
1:5 | 94.0 | 71.8 | 0.79 (0.56–1.00) |
2:3 | 90.0 | 66.8 | 0.70 (0.45–0.95) |
2:4 | 92.0 | 68.0 | 0.75 (0.52–0.98) |
2:5 | 92.0 | 70.4 | 0.73 (0.48–0.98) |
3:4 | 98.0 | 66.8 | 0.94 (0.82–1.00) |
3:5 | 94.0 | 69.0 | 0.81 (0.60–1.00) |
4:5 | 96.0 | 70.4 | 0.87 (0.68–1.00) |
1:2:3:4:5 | 92.4 | 69.0 | 0.76 (0.55–0.89) |