Inter-rater reliability for fixed prosthesis
Cohen’s weighted kappa | ||||||
---|---|---|---|---|---|---|
Ratings | Weighted kappaa | Asymptotic | 95% Asymptotic confidence interval | |||
Standard errorb | zc | Sig. | Lower bound | Upper bound | ||
observer 1–observer 2 | 0.878 | 0.021 | 22.444 | < 0.001 | 0.837 | 0.918 |
observer 1–observer 3 | 0.866 | 0.022 | 22.178 | < 0.001 | 0.823 | 0.909 |
observer 1–observer 4 | 0.894 | 0.020 | 23.123 | < 0.001 | 0.855 | 0.934 |
observer 1–AI | 0.906 | 0.019 | 23.347 | < 0.001 | 0.868 | 0.944 |
observer 2–observer 3 | 0.922 | 0.017 | 23.318 | < 0.001 | 0.888 | 0.956 |
observer 2–observer 4 | 0.920 | 0.017 | 23.550 | < 0.001 | 0.886 | 0.954 |
observer 2–AI | 0.943 | 0.015 | 24.197 | < 0.001 | 0.913 | 0.974 |
observer 3–observer 4 | 0.935 | 0.015 | 23.894 | < 0.001 | 0.906 | 0.963 |
observer 3–AI | 0.939 | 0.014 | 24.141 | < 0.001 | 0.912 | 0.966 |
observer 4–AI | 0.959 | 0.012 | 24.725 | < 0.001 | 0.935 | 0.983 |
a The estimation of the weighted kappa uses linear weights; b value does not depend on either null or alternative hypotheses; c estimates the asymptotic standard error assuming the null hypothesis that weighted kappa is zero. Sig: significance