This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
wiki:autolit:screening:dual [2023/08/10 14:15] jthurnham [3. Adjudicate Disagreements] |
wiki:autolit:screening:dual [2024/04/01 11:57] jthurnham |
||
---|---|---|---|
Line 16: | Line 16: | ||
To configure dual screening in a nest, click on the " | To configure dual screening in a nest, click on the " | ||
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-05_at_16.33.45.png? |
Once this is complete, a new " | Once this is complete, a new " | ||
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-05_at_16.40.54.png? |
<WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | <WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | ||
Line 31: | Line 31: | ||
In Dual Screening, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the include button (see below). 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on. | In Dual Screening, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the include button (see below). 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on. | ||
- | {{ :undefined:prior_reveiewrs.png?nolink |}} | + | {{ :undefined:screenshot_2023-12-05_at_16.47.10.png?nolink |}} |
However, in Dual modes the status of whether the full text has been uploaded or not by the other reviewer is hidden. This is to avoid bias as the knowledge that the other user has uploaded the record' | However, in Dual modes the status of whether the full text has been uploaded or not by the other reviewer is hidden. This is to avoid bias as the knowledge that the other user has uploaded the record' | ||
- | {{ :undefined:show_anyway.png?nolink |}} | + | {{ :undefined:screenshot_2023-12-05_at_16.48.21.png?nolink |}} |
- | ==== 2. [OPTIONAL] Auto-Adjudicate | + | 2. [OPTIONAL] Auto-Adjudicate |
+ | All studies that have undergone two screening decisions are sent forward for adjudication, | ||
- | All studies that have undergone two screening decisions are sent forward for adjudication, | + | {{ : |
- | To Auto-Adjudicate | + | This will bring up the Auto-Adjudicate |
+ | * **Any** -- selected by default, if both screeners chose to exclude a record, for any reason, its final decision | ||
+ | * **Exact** -- if both screeners chose to exclude a record for the exact same reason, its final decision will be excluded for this reason | ||
+ | * **Shared** -- if both screeners chose to exclude | ||
- | If Screener 1 and Screener 2 selected different Exclusion Reasons, the Auto-Adjudication will select only one of these and apply it as the final Exclusion Reason. | + | {{ : |
- | {{: | + | ==== 3. Adjudicate Disagreements ==== |
+ | For any study that is not Auto-Adjudicated, | ||
- | ==== 3. Adjudicate Disagreements ==== | + | Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[: |
- | For any study that is not Auto-Adjudicated, | ||
- | |||
- | Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki: | ||
==== Kappa Statistics for Interrater Reliability ==== | ==== Kappa Statistics for Interrater Reliability ==== | ||
- | After you finish Dual Screening, you can view the [[wiki: | + | After you finish Dual Screening, you can view the [[:wiki: |
==== Guidance on Dual Screening Best Practices ==== | ==== Guidance on Dual Screening Best Practices ==== | ||
For guidance on best practices in Dual Screening, click [[: | For guidance on best practices in Dual Screening, click [[: | ||
- | |||