Nested Knowledge

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Dual Two-Pass Screening ======

Dual Two-Pass screening is a sequential, quality controlled screening process that has two steps. In the first step, two users sequentially Advance or Exclude articles at the Abstract level. Any disagreements at this step are adjudicated by an Admin. In the second step, two users conduct a Full Text Review and Include or Exclude articles. All disagreements this second step must also be adjudicated by an Admin.

**//Only those with Admin privileges can serve as Adjudicators, but any user can serve as a Screener.// **
===== Configure Exclusion Reasons =====

You will need to [[:wiki:autolit:screening:configure|Configuring Exclusion Reasons]] before screening underlying studies.

===== Configure Dual Two-Pass Screening =====

==== Navigate to Settings and select "Dual" and "Two-Pass" ====

{{ :undefined:screenshot_2023-12-06_at_15.28.24.png?nolink |}}

<WRAP center round important 60%> **Note:** Toggling back from Dual Screening to Standard Screening (or switching to Two-Pass Screening) will ONLY save final adjudications, so all records without an adjudicated Include or Exclude decision will be reverted to Unscreened and **all data associated with individual users' decisions will be lost**! </WRAP>


===== Dual Two-Pass Screening Steps: =====

==== 1. Screen each study twice at the abstract level. ====

Two independent reviewers will need to review the abstract of every study and [[:wiki:autolit:screening:exclude|screen]] the abstracts using the same approach as Standard Screening Mode with the exception that studies are only advanced to full-text screening at this stage instead of included. AutoLit automatically queues the abstracts to all users until two screening decisions are made; then, the abstracts are sent forward for adjudication.

{{ :undefined:screenshot_2023-12-06_at_15.29.19.png?nolink |}}

In Dual modes, it can be useful to view the number of prior reviewers for the current record. This is displayed to the right of the advance button (see below). It is also displayed next to the include button in Full Text screening. 0 means no decisions have been made about the current record, 1 means 1 reviewer has made a decision, and so on.

{{ :undefined:screenshot_2023-12-06_at_15.30.20.png?nolink |}}

Even in Abstract Screening, you may want to view the full text, to do so go to the Full Text tab. In Dual Screening types, the status of whether the full text has been uploaded or not is hidden. This is to avoid bias as the knowledge that the other user has uploaded the record's full text may influence your screening decision. You still have the option to show the full text upload status as well as the full text regardless by clicking “Show Anyways.” This action does not affect your screening decisions and is not shown in the Full Text Screening module since all full texts will be uploaded.


==== 2. Adjudicate decision for abstracts ====

There is an option to [[:wiki:autolit:screening:dual#optional_auto-adjudicate|auto-adjudicate]]. For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision on the abstracts. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option. Once adjudicated, the studies will either be excluded or advanced and sent forward to Full Text Screening.

Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki:autolit:admin:configure#blinding|Blind Adjudication in Settings.]]

If you have Robot Screener turned on, its decisions will be shown in Abstract Adjudication and not Full Text Adjudication. This is because, in Dual Two Pass mode, Robot Screener only runs on abstracts. Learn more [[https://wiki.nested-knowledge.com/doku.php?id=wiki:autolit:screening:robot|here.]]

{{ :undefined:screenshot_2023-12-06_at_15.31.44.png?nolink |}}


==== 4. Screen the full-text of each study. ====

Two independent reviewers will need to review the full-text of every study and [[:wiki:autolit:screening:exclude|screen]] the abstracts using the same approach as Standard Screening Mode. AutoLit automatically queues the full-texts to all users until two screening decisions are made; then, the articles are sent forward for adjudication.

{{ :undefined:screenshot_2023-12-06_at_15.35.35.png?nolink |}}


==== 5. Adjudicate decisions for full-texts ====

There is an option to [[:wiki:autolit:screening:dual#optional_auto-adjudicate|auto-adjudicate]]. For any study that is not Auto-Adjudicated, an Admin will need to manually adjudicate in order to provide a final screening decision on the full-texts. The Admin should choose between selecting the decision of Screener 1 or Screener 2, or if both are incorrect, provide a different option. Once adjudicated, the studies will either be excluded or included.

Note: by default, the names of the reviewers will be displayed alongside their decisions. You may want to reduce bias by hiding this information. To do so you can [[wiki:autolit:admin:configure#blinding|Blind Adjudication in Settings.]]

{{ :undefined:screenshot_2023-12-06_at_15.37.05.png?nolink |}}

==== Kappa Statistics for Interrater Reliability ====

After you finish Dual Screening, you can view the [[wiki:autolit:screening:kappastatistics|Kappa statistics]] in [[wiki:autolit:utilities:activity|Activity]].

==== Guidance on Dual Screening Best Practices ====

For guidance on best practices in Dual Screening, click [[:wiki:guide:research:screen#dual_screening|here]].

{{  https://wiki.nested-knowledge.com//home/ubuntu/nkwiki/dokuwiki/lib/plugins/ckgedit/fckeditor/userfiles/image/wiki/autolit/screening/3.png?nolink&  }}
Nested Knowledge

User Tools

Site Tools

Page Tools
