This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
wiki:autolit:screening:dualtwopass [2023/08/10 14:16] jthurnham [2. Adjudicate decision for abstracts] |
wiki:autolit:screening:dualtwopass [2023/12/06 15:38] (current) jthurnham |
||
---|---|---|---|
Line 10: | Line 10: | ||
===== Configure Dual Two-Pass Screening ===== | ===== Configure Dual Two-Pass Screening ===== | ||
- | ==== 1. Click on Settings ==== | + | ==== Navigate to Settings |
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-06_at_15.28.24.png? |
- | + | ||
- | + | ||
- | ==== 3. Scroll to Screening settings. Select Two Pass under Mode and Dual under Number of Reviewers. ==== | + | |
- | + | ||
- | {{: | + | |
<WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | <WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, | ||
Line 26: | Line 21: | ||
==== 1. Screen each study twice at the abstract level. ==== | ==== 1. Screen each study twice at the abstract level. ==== | ||
- | Two independent reviewers will need to review the abstract of every study and [[: | + | Two independent reviewers will need to review the abstract of every study and [[: |
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-06_at_15.29.19.png? |
In Dual modes, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the advance button (see below). It is also displayed next to the include button in Full Text screening. 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on. | In Dual modes, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the advance button (see below). It is also displayed next to the include button in Full Text screening. 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on. | ||
- | {{ :undefined:screening_decisionss.png?nolink |}} | + | {{ :undefined:screenshot_2023-12-06_at_15.30.20.png?nolink |}} |
Even in Abstract Screening, you may want to view the full text, to do so go to the Full Text tab. In Dual Screening types, the status of whether the full text has been uploaded or not is hidden. This is to avoid bias as the knowledge that the other user has uploaded the record' | Even in Abstract Screening, you may want to view the full text, to do so go to the Full Text tab. In Dual Screening types, the status of whether the full text has been uploaded or not is hidden. This is to avoid bias as the knowledge that the other user has uploaded the record' | ||
- | |||
- | {{ : | ||
Line 45: | Line 38: | ||
Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki: | Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki: | ||
- | {{: | + | If you have Robot Screener turned on, its decisions will be shown in Abstract Adjudication and not Full Text Adjudication. This is because, in Dual Two Pass mode, Robot Screener only runs on abstracts. Learn more [[https:// |
+ | |||
+ | {{ : | ||
Line 52: | Line 47: | ||
Two independent reviewers will need to review the full-text of every study and [[: | Two independent reviewers will need to review the full-text of every study and [[: | ||
- | {{:wiki:autolit: | + | {{ :undefined:screenshot_2023-12-06_at_15.35.35.png? |
Line 59: | Line 54: | ||
There is an option to [[: | There is an option to [[: | ||
- | {{: | + | Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki: |
+ | |||
+ | {{ : | ||
==== Kappa Statistics for Interrater Reliability ==== | ==== Kappa Statistics for Interrater Reliability ==== |