Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:screening:robot

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
wiki:autolit:screening:robot [2023/05/17 22:43]
jthurnham
wiki:autolit:screening:robot [2023/05/17 23:13]
jthurnham [Enabling Robot Screener]
Line 7: Line 7:
 Robot Screener may be enabled from Screening Settings. When Dual Screening mode (standard or two pass) is switched on, Robot Screener can be switched on under "Screening Model". Before Robot Screener can be enabled, the nest must: Robot Screener may be enabled from Screening Settings. When Dual Screening mode (standard or two pass) is switched on, Robot Screener can be switched on under "Screening Model". Before Robot Screener can be enabled, the nest must:
  
-  * Be configured for [[wiki:autolit:screening:dual|]]+  * Be configured for [[wiki:autolit:screening:dual|Dual Screening]] or [[wiki:autolit:screening:dualtwopass|Dual Two Pass Screening]]
   * And contain **50**  adjudicated //records //  (i.e. having an adjudicated screening decision, abstract or full text)   * And contain **50**  adjudicated //records //  (i.e. having an adjudicated screening decision, abstract or full text)
   * And contain **10**  included records (or abstract advanced for two pass mode)   * And contain **10**  included records (or abstract advanced for two pass mode)
Line 18: Line 18:
  
 {{ :undefined:robo.png?nolink |}} {{ :undefined:robo.png?nolink |}}
- 
-Doing Robot Screener in Two Pass Mode and need more guidance? [[wiki:autolit:screening:dualtwopass|See here.]] 
  
 ===== In Action ===== ===== In Action =====
Line 48: Line 46:
  
   * While Robot Screener may be enabled at 50 adjudicated / 10 included records, we typically advise not enabling it until a cross validation recall of 0.7 or greater is achieved.   * While Robot Screener may be enabled at 50 adjudicated / 10 included records, we typically advise not enabling it until a cross validation recall of 0.7 or greater is achieved.
-  * Avoid use of the "Auto-adjudicate" button, especially early on. The model (and human reviewer) should be subject to scrutiny. This will improve the quality of your review, reduce later reworks, and produce better training data for Robot Screener.+  * Only use the "Auto-adjudicate" button when you are confident in trusting a single human review with only the Robot as a 'check'. This may mean manually reviewing records that the human and Robot agree on, especially early on. This will improve the quality of your review, reduce later reworks, and produce better training data for Robot Screener.
  
 Learn more about [[wiki:autolit:screening:inclusionpredictionmodel|the Screening model that powers Robot Screener here.]] Learn more about [[wiki:autolit:screening:inclusionpredictionmodel|the Screening model that powers Robot Screener here.]]
 +
 +===== Why can't I turn on Robot Screener yet? =====
 +
 +It may be due to not having enough screening decisions in your nest. [[wiki:autolit:screening:robot#enabling_robot_screener|See the requirements above.]]
 +
 +If you are in Dual Two Pass Screening mode, Robot Screener can be used for //both// Abstract Screening and Full Text Screening but the requirements must be met separately.
 +
 +   * Abstract Screening requires **50**  abstract adjudicated records, either advanced or excluded under Abstract Screening –> Adjudicate Screening, and **10**  advanced records
 +      * These actions must be performed before Robot Screener can be turned on for Abstract Screening
 +
 +  * Full Text Screening requires **50**  full text adjudicated records, either included or excluded under Full Text Screening –> Adjudicate Screening, and **10**  included records
 +      * These actions must be performed before Robot Screener can be turned on for Full Text Screening
  
  
wiki/autolit/screening/robot.txt · Last modified: 2024/03/06 02:40 by kevinkallmes