This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
wiki:autolit:screening:dual [2022/10/07 18:19] nicole_hardy_alumni.brown.edu |
wiki:autolit:screening:dual [2024/04/01 11:59] (current) jthurnham |
||
---|---|---|---|
Line 14: | Line 14: | ||
===== Configure Dual Screening ===== | ===== Configure Dual Screening ===== | ||
- | To configure dual screening in a nest, click on the "Admin" link in the Nest menu. Once here, scroll down to the Screening section. Then, click on the " | + | To configure dual screening in a nest, click on the "Settings" link under Nest Home. Once there, scroll down to the Screening section. Then, click on the " |
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-05_at_16.33.45.png?nolink |}} |
Once this is complete, a new " | Once this is complete, a new " | ||
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-05_at_16.40.54.png?nolink |}} |
<WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | <WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | ||
Line 27: | Line 27: | ||
==== 1. Screen each study twice ==== | ==== 1. Screen each study twice ==== | ||
- | Before Adjudication can take place, two independent users will need to [[: | + | Before Adjudication can take place, two independent users will need to [[: |
- | ==== 2. [OPTIONAL] Auto-Adjudicate ==== | + | In Dual Screening, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the include button (see below). 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on. |
- | All studies that have undergone two screening decisions are sent forward for adjudication, | + | {{ : |
- | To Auto-Adjudicate all eligible studies, navigate to Adjudicate Screening, and in the upper right, select " | + | However, in Dual modes the status of whether the full text has been uploaded or not by the other reviewer is hidden. This is to avoid bias as the knowledge |
- | If Screener 1 and Screener 2 selected different Exclusion Reasons, the Auto-Adjudication will select only one of these and apply it as the final Exclusion Reason. | + | {{ : |
- | {{: | + | ==== 2. [OPTIONAL] Auto-Adjudicate ==== |
+ | |||
+ | All studies that have undergone two screening decisions are sent forward for adjudication, | ||
+ | |||
+ | {{ :undefined: | ||
+ | |||
+ | This will bring up the Auto-Adjudicate Settings modal, allowing you to decide which sets of records should be auto-adjudicated. | ||
+ | * **Any** -- selected by default, if both screeners chose to exclude a record, for any reason, its final decision will be excluded. | ||
+ | * **Exact** -- if both screeners chose to exclude a record for the exact same reason, its final decision will be excluded for this reason | ||
+ | * **Shared** -- if both screeners chose to exclude a record for different reasons but both reasons share a parent reason, its final decision will be excluded for the parent reason. For example, let's say the reason: Study Type was created, with reasons such as Randomized Controlled Trial, Observational Study, Case Study, etc. created beneath it. If Screener 1 excluded for Randomized Controlled Trial, and Screener 2 excluded for Case Study, this will make the final decision excluded due to Study Type (the parent reason). See more on [[wiki: | ||
+ | |||
+ | {{ : | ||
==== 3. Adjudicate Disagreements ==== | ==== 3. Adjudicate Disagreements ==== | ||
- | For any study that is not Auto-Adjudicated, | + | For any study that is not Auto-Adjudicated, |
+ | |||
+ | Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[: | ||
+ | |||
+ | ==== Kappa Statistics for Interrater Reliability ==== | ||
+ | |||
+ | After you finish Dual Screening, you can view the [[: | ||
==== Guidance on Dual Screening Best Practices ==== | ==== Guidance on Dual Screening Best Practices ==== | ||
For guidance on best practices in Dual Screening, click [[: | For guidance on best practices in Dual Screening, click [[: | ||
- | |||