Inter-rater reliability for all three reviewers for seriousness
| Outcome | Frequency reported by each reviewer, N (%) | κ (95% CI) | ||||
|---|---|---|---|---|---|---|
| Reviewer 1 | Reviewer 2 | Reviewer 3 | ||||
| *Seriousness categories (D, L, H, P, O) combined. | ||||||
| Seriousness category | ||||||
| D, potential death | 0 (0) | 1 (0.1) | 14 (2.0) | 0.06 (0.02 to 0.10) | ||
| L, life threatening | 10 (1.4) | 11 (1.6) | 15 (2.1) | 0.30 (0.26 to 0.34) | ||
| H, hospitalisation | 27 (3.9) | 11 (1.6) | 12 (1.7) | 0.34 (0.30 to 0.38) | ||
| P, persistent disability | 20 (2.9) | 5 (0.7) | 14 (2.0) | 0.16 (0.12 to 0.20) | ||
| O, intervention to prevent permanent impairment | 3 (0.4) | 55 (7.9) | 3 (0.4) | 0.07 (0.03 to 0.11) | ||
| N, not serious | 641 (91.4) | 618 (88.2) | 643 (91.7) | 0.50 (0.46 to 0.54) | ||
| Overall agreement | 0.34 (0.32 to 0.36) | |||||
| Seriousness category grouping | ||||||
| Serious* v not serious | 0.50 (0.46 to 0.54) | |||||