Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:screening:dual

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Last revision Both sides next revision
wiki:autolit:screening:dual [2024/04/01 11:43]
jthurnham [2. [OPTIONAL] Auto-Adjudicate]
wiki:autolit:screening:dual [2024/04/01 11:57]
jthurnham
Line 36: Line 36:
  
 {{ :undefined:screenshot_2023-12-05_at_16.48.21.png?nolink |}} {{ :undefined:screenshot_2023-12-05_at_16.48.21.png?nolink |}}
 +
 +2. [OPTIONAL] Auto-Adjudicate
 +All studies that have undergone two screening decisions are sent forward for adjudication, and any study that is either Included by both Screeners or Excluded by both Screeners is eligible for Auto-Adjudication.To Auto-Adjudicate all eligible studies, navigate to Adjudicate Screening, and in the upper right, select “Auto-adjudicate {x} studies”. 
 +
 +{{ :undefined:screenshot_2024-04-01_at_12.56.21.png?nolink |}}
 +
 +This will bring up the Auto-Adjudicate Settings modal, allowing you to decide which sets of records should be auto-adjudicated.
 +  * **Any** -- selected by default, if both screeners chose to exclude a record, for any reason, its final decision will be excluded.
 +  * **Exact** -- if both screeners chose to exclude a record for the exact same reason, its final decision will be excluded for this reason
 +  * **Shared** -- if both screeners chose to exclude a record for different reasons but both reasons share a parent reason, its final decision will be excluded for the parent reason. For example, let's say the reason: Study Type was created, with reasons such as Randomized Controlled Trial, Observational Study, Case Study, etc. created beneath it. If Screener 1 excluded for Randomized Controlled Trial, and Screener 2 excluded for Case Study, this will make the final decision excluded due to Study Type (the parent reason). See more on [[wiki:autolit:screening:configure#editing_ordering_and_deleting_exclusion_reasons|hierarchical exclusion reasons.]]
 +
 +{{ :undefined:screenshot_2024-04-01_at_12.56.45.png?nolink |}}
  
 ==== 3. Adjudicate Disagreements ==== ==== 3. Adjudicate Disagreements ====
Line 50: Line 62:
  
 For guidance on best practices in Dual Screening, click [[:wiki:guide:research:screen#dual_screening|here]]. For guidance on best practices in Dual Screening, click [[:wiki:guide:research:screen#dual_screening|here]].
- 
- 
-==== 3. Adjudicate Disagreements ==== 
- 
-For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option ( <font inherit/inherit;;#e74c3c;;inherit>red box</font> ). Once adjudicated, the studies will either be excluded or included and sent forward to [[:wiki:autolit:tagging|]]. 
- 
-Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki:autolit:admin:configure#blinding|Blind Adjudication in Settings.]] 
-==== Kappa Statistics for Interrater Reliability ==== 
- 
-After you finish Dual Screening, you can view the [[wiki:autolit:screening:kappastatistics|Kappa statistics]] in [[wiki:autolit:utilities:activity|Activity]]. 
- 
-==== Guidance on Dual Screening Best Practices ==== 
- 
-For guidance on best practices in Dual Screening, click [[:wiki:guide:research:screen#dual_screening|here]]. 
- 
  
wiki/autolit/screening/dual.txt · Last modified: 2024/04/01 11:59 by jthurnham