This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
wiki:autolit:screening:dual [2022/11/20 00:17] nicole_hardy_alumni.brown.edu [Configure Dual Screening] |
wiki:autolit:screening:dual [2024/04/01 11:43] jthurnham [2. [OPTIONAL] Auto-Adjudicate] |
||
---|---|---|---|
Line 14: | Line 14: | ||
===== Configure Dual Screening ===== | ===== Configure Dual Screening ===== | ||
- | To configure dual screening in a nest, click on the " | + | To configure dual screening in a nest, click on the " |
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-05_at_16.33.45.png? |
Once this is complete, a new " | Once this is complete, a new " | ||
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-05_at_16.40.54.png? |
<WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | <WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | ||
- | |||
- | |||
===== Dual Screening Steps ===== | ===== Dual Screening Steps ===== | ||
==== 1. Screen each study twice ==== | ==== 1. Screen each study twice ==== | ||
- | Before Adjudication can take place, two independent users will need to [[: | + | Before Adjudication can take place, two independent users will need to [[: |
- | ==== 2. [OPTIONAL] Auto-Adjudicate ==== | + | In Dual Screening, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the include button (see below). 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on. |
- | All studies that have undergone two screening decisions are sent forward for adjudication, | + | {{ : |
- | To Auto-Adjudicate all eligible studies, navigate to Adjudicate Screening, and in the upper right, select " | + | However, in Dual modes the status of whether the full text has been uploaded or not by the other reviewer is hidden. This is to avoid bias as the knowledge |
- | If Screener 1 and Screener 2 selected | + | {{ : |
+ | |||
+ | ==== 3. Adjudicate Disagreements ==== | ||
+ | |||
+ | For any study that is not Auto-Adjudicated, | ||
+ | |||
+ | Note: by default, | ||
+ | |||
+ | ==== Kappa Statistics for Interrater Reliability ==== | ||
+ | |||
+ | After you finish Dual Screening, you can view the [[: | ||
+ | |||
+ | ==== Guidance on Dual Screening Best Practices ==== | ||
+ | |||
+ | For guidance on best practices in Dual Screening, click [[: | ||
- | {{: | ||
==== 3. Adjudicate Disagreements ==== | ==== 3. Adjudicate Disagreements ==== | ||
- | For any study that is not Auto-Adjudicated, | + | For any study that is not Auto-Adjudicated, |
+ | |||
+ | Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki: | ||
+ | ==== Kappa Statistics for Interrater Reliability ==== | ||
+ | |||
+ | After you finish Dual Screening, you can view the [[wiki: | ||
==== Guidance on Dual Screening Best Practices ==== | ==== Guidance on Dual Screening Best Practices ==== |