Differences

This shows you the differences between two versions of the page.

--- wiki:autolit:screening:dual [2023/12/05 16:49]
jthurnham [1. Screen each study twice]
+++ wiki:autolit:screening:dual [2024/04/01 11:43]
jthurnham [2. [OPTIONAL] Auto-Adjudicate]
@@ Line 37: / Line 37: @@
 {{ :undefined:screenshot_2023-12-05_at_16.48.21.png?nolink |}}
-==== 2. [OPTIONAL] Auto-Adjudicate ====
+==== 3. Adjudicate Disagreements ====
-All studies that have undergone two screening decisions are sent forward for adjudication, and any study that is either Included by both Screeners or Excluded by both Screeners is eligible for Auto-Adjudication.
+For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option ( <font inherit/inherit;;#e74c3c;;inherit>red box</font>  ). Once adjudicated, the studies will either be excluded or included and sent forward to [[:wiki:autolit:tagging|]].
-To Auto-Adjudicate all eligible studies, navigate to Adjudicate Screening, and in the upper right, select "Auto-adjudicate {x} studies" ( <font inherit/inherit;;#e74c3c;;inherit>red box</font> ). This will automatically include all studies that both Screeners included, and exclude all studies that both Screeners excluded.
+Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[:wiki:autolit:admin:configure#blinding|Blind Adjudication in Settings.]]
-If Screener 1 and Screener 2 selected different Exclusion Reasons, the Auto-Adjudication will select only one of these and apply it as the final Exclusion Reason.
+==== Kappa Statistics for Interrater Reliability ====
-{{:wiki:autolit:screening:img68.png?nolink&  }}
+After you finish Dual Screening, you can view the [[:wiki:autolit:screening:kappastatistics|Kappa statistics]] in [[:wiki:autolit:utilities:activity|Activity]].
+==== Guidance on Dual Screening Best Practices ====
+For guidance on best practices in Dual Screening, click [[:wiki:guide:research:screen#dual_screening|here]].

Nested Knowledge

User Tools

Site Tools

Differences

Page Tools