Nested Knowledge

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.

====== Kappa Statistics for Interrater Reliability ======

The Kappa Statistic or Cohen's Kappa is a statistical measure of inter-rater reliability for categorical variables. These statistics are  important as they represent the extent to which the data collected in the study are correct representations of the variables measured. Learn more about Kappa Statistics [[https://pubmed.ncbi.nlm.nih.gov/23092060/#:~:text=The%20kappa%20statistic%20is%20frequently,representations%20of%20the%20variables%20measured. | here.]]

===== Screening Agreement =====

Nested Knowledge provides the built-in analytic in Activity when a Dual Screening mode is switched on, and screening has been performed by multiple reviewers. To access this information, click on Activity, then Screening Agreement next to User Contributions (see below).

{{ :undefined:kappaactivity.png?nolink |}}

Clicking Screening Agreement opens up a modal. This modal provides you with live kappa scores as well as inter reviewer reliability across each team member.

{{ :undefined:kappa2.png?nolink |}}

You can also compare the stats between specific reviewers by utilizing the dropdown:

{{ :undefined:dropkappa.png?nolink |}}

Nested Knowledge

User Tools

Site Tools

Page Tools