Differences

This shows you the differences between two versions of the page.

--- wiki:autolit:screening:robot [2023/05/17 22:56]
jthurnham
+++ wiki:autolit:screening:robot [2023/06/14 22:44]
jthurnham [Why can't I turn on Robot Screener yet?]
@@ Line 7: / Line 7: @@
 Robot Screener may be enabled from Screening Settings. When Dual Screening mode (standard or two pass) is switched on, Robot Screener can be switched on under "Screening Model". Before Robot Screener can be enabled, the nest must:
-  * Be configured for [[wiki:autolit:screening:dual|]]
+  * Be configured for [[wiki:autolit:screening:dual|Dual Screening]] or [[wiki:autolit:screening:dualtwopass|Dual Two Pass Screening]]
   * And contain **50**  adjudicated //records //  (i.e. having an adjudicated screening decision, abstract or full text)
   * And contain **10**  included records (or abstract advanced for two pass mode)
@@ Line 46: / Line 46: @@
   * While Robot Screener may be enabled at 50 adjudicated / 10 included records, we typically advise not enabling it until a cross validation recall of 0.7 or greater is achieved.
-  * Avoid use of the "Auto-adjudicate" button, especially early on. The model (and human reviewer) should be subject to scrutiny. This will improve the quality of your review, reduce later reworks, and produce better training data for Robot Screener.
+  * Only use the "Auto-adjudicate" button when you are confident in trusting a single human review with only the Robot as a 'check'. This may mean manually reviewing records that the human and Robot agree on, especially early on. This will improve the quality of your review, reduce later reworks, and produce better training data for Robot Screener.
 Learn more about [[wiki:autolit:screening:inclusionpredictionmodel|the Screening model that powers Robot Screener here.]]
-===== Guidance on Robot Screener in Dual Two Pass Mode =====
+===== Why can't I turn on Robot Screener yet? =====
-To clarify, Robot Screener can be used for //both// Abstract Screening and Full Text Screening but the requirements must be met separately.
+It may be due to not having enough screening decisions in your nest. [[:wiki:autolit:screening:robot#enabling_robot_screener|See the requirements above.]]
-  * Abstract Screening requires **50**  abstract adjudicated records, either advanced or excluded under Abstract Screening --> Adjudicate Screening, and **10** advanced records
-    * These actions must be performed before Robot Screener can be turned on for Abstract Screening
+If you are in Dual Two Pass Screening mode, Robot Screener can currently only be used for Abstract Screening and not Full Text Screening. The requirements must be fulfilled prior to turning on Robot Screener:
+  * Abstract Screening requires **50**  abstract adjudicated records, either advanced or excluded under Abstract Screening –> Adjudicate Screening, and **10**  advanced records
+      * These actions must be performed before Robot Screener can be turned on for Abstract Screening
-  * Full Text Screening requires **50** full text adjudicated records, either included or excluded under Full Text Screening --> Adjudicate Screening, and **10** included records
-    * These actions must be performed before Robot Screener can be turned on for Full Text Screening

Nested Knowledge

User Tools

Site Tools

Differences

Page Tools