Question (number of choices) | Observed agreement (%) | Kappa value |
---|---|---|
Main themes (8 choices) | 91.1 | 0.88 |
Key perspectives (9 choices) | 83.9 | 0.77 |
Benefit stated (yes/no) | 94.6 | 0.88 |
Risk stated (yes/no) | 96.4 | 0.93 |
Main source of information (7 choices) | 75.0 | 0.67 |
Main voice (7 choices) | 83.9 | 0.77 |
Quotation stated (yes/no) | 91.1 | 0.82 |
Article slant (4 choices) | 85.7 | 0.80 |
Main claim (3 choices) | 75.0 | 0.60 |
Quality of information (3 choices) | 83.9 | 0.75 |