Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:screening:dualtwopass

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
wiki:autolit:screening:dualtwopass [2022/11/20 00:36]
nicole_hardy_alumni.brown.edu [4. Screen the full-text of each study.]
wiki:autolit:screening:dualtwopass [2023/08/10 14:16]
jthurnham [5. Adjudicate decisions for full-texts]
Line 29: Line 29:
  
 {{:wiki:autolit:screening:img71.png?nolink&  }} {{:wiki:autolit:screening:img71.png?nolink&  }}
 +
 +In Dual modes, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the advance button (see below). It is also displayed next to the include button in Full Text screening. 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on.
 +
 +{{ :undefined:screening_decisionss.png?nolink |}}
 +
 +Even in Abstract Screening, you may want to view the full text, to do so go to the Full Text tab. In Dual Screening types, the status of whether the full text has been uploaded or not is hidden. This is to avoid bias as the knowledge that the other user has uploaded the record's full text may influence your screening decision. You still have the option to show the full text upload status as well as the full text regardless by clicking “Show Anyways.” This action does not affect your screening decisions and is not shown in the Full Text Screening module since all full texts will be uploaded.
 +
 +{{ :undefined:abs_show_anyway.png?nolink |}}
  
  
Line 34: Line 42:
  
 There is an option to [[:wiki:autolit:screening:dual#optional_auto-adjudicate|auto-adjudicate]]. For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision on the abstracts. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option. Once adjudicated, the studies will either be excluded or advanced and sent forward to Full Text Screening. There is an option to [[:wiki:autolit:screening:dual#optional_auto-adjudicate|auto-adjudicate]]. For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision on the abstracts. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option. Once adjudicated, the studies will either be excluded or advanced and sent forward to Full Text Screening.
 +
 +Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki:autolit:admin:configure#blinding|Blind Adjudication in Settings.]]
  
 {{:wiki:autolit:screening:img72.png?nolink&  }} {{:wiki:autolit:screening:img72.png?nolink&  }}
Line 49: Line 59:
 There is an option to [[:wiki:autolit:screening:dual#optional_auto-adjudicate|auto-adjudicate]]. For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision on the full-texts. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option. Once adjudicated, the studies will either be excluded or included. There is an option to [[:wiki:autolit:screening:dual#optional_auto-adjudicate|auto-adjudicate]]. For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision on the full-texts. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option. Once adjudicated, the studies will either be excluded or included.
  
-{{  :wiki:autolit:screening:9.png?nolink&  }}+Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki:autolit:admin:configure#blinding|Blind Adjudication in Settings.]] 
 + 
 +{{:wiki:autolit:screening:img74.png?nolink&  }} 
 + 
 +==== Kappa Statistics for Interrater Reliability ==== 
 + 
 +After you finish Dual Screening, you can view the [[wiki:autolit:screening:kappastatistics|Kappa statistics]] in [[wiki:autolit:utilities:activity|Activity]].
  
 ==== Guidance on Dual Screening Best Practices ==== ==== Guidance on Dual Screening Best Practices ====
wiki/autolit/screening/dualtwopass.txt · Last modified: 2023/12/06 15:38 by jthurnham