This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
wiki:autolit:screening:robot [2023/05/17 20:00] jthurnham |
wiki:autolit:screening:robot [2023/06/14 22:44] jthurnham [Why can't I turn on Robot Screener yet?] |
||
---|---|---|---|
Line 7: | Line 7: | ||
Robot Screener may be enabled from Screening Settings. When Dual Screening mode (standard or two pass) is switched on, Robot Screener can be switched on under " | Robot Screener may be enabled from Screening Settings. When Dual Screening mode (standard or two pass) is switched on, Robot Screener can be switched on under " | ||
- | * Be configured for [[wiki: | + | * Be configured for [[wiki: |
- | * And contain **50** | + | * And contain **50** |
- | * And contain **10** | + | * And contain **10** |
The latter two requirements help ensure a minimum model accuracy; however, the model will usually be suboptimal with this volume of training data, and typically improves as more records are screened. | The latter two requirements help ensure a minimum model accuracy; however, the model will usually be suboptimal with this volume of training data, and typically improves as more records are screened. | ||
Line 15: | Line 15: | ||
By enabling Robot Screener, automatic updating to the screening model is made non-optional, | By enabling Robot Screener, automatic updating to the screening model is made non-optional, | ||
- | When switching on Robot Screener, you will see the below modal. In red are the actual numbers of adjudicated and included records compared to the numbers you need to meet in order to Enable Robot Screener: | + | When switching on Robot Screener, you will see the below modal. In red are the actual numbers of adjudicated and included |
{{ : | {{ : | ||
Line 23: | Line 23: | ||
==== Which Records ==== | ==== Which Records ==== | ||
- | Robot Screener automatically adds a reviewer-level screening decision to records with: | + | Robot Screener automatically adds a single |
* Fewer than 2 reviewer-level screening decisions | * Fewer than 2 reviewer-level screening decisions | ||
Line 35: | Line 35: | ||
* Robot Screener is enabled | * Robot Screener is enabled | ||
- | * A new inclusion | + | * A new Screening |
* New records are imported into your nest | * New records are imported into your nest | ||
- | * 10 addditional | + | * 10 additional |
As pointed out above, Robot Screener will not modify its decision on a record after that record has been adjudicated. Prior to adjudication, | As pointed out above, Robot Screener will not modify its decision on a record after that record has been adjudicated. Prior to adjudication, | ||
Line 45: | Line 45: | ||
Robot Screener, by accuracy, is not a replacement for a human reviewer. It should typically be used for reviews where budget, team size, or time available are restricted. Some additional usage tips: | Robot Screener, by accuracy, is not a replacement for a human reviewer. It should typically be used for reviews where budget, team size, or time available are restricted. Some additional usage tips: | ||
- | * While Robot Screener may be enabled at 50 adjudicated / 5 included records, we typically advise not enabling it until a cross validation | + | * While Robot Screener may be enabled at 50 adjudicated / 10 included records, we typically advise not enabling it until a cross validation |
- | * Avoid use of the " | + | * Only use the " |
+ | |||
+ | Learn more about [[wiki: | ||
+ | |||
+ | ===== Why can't I turn on Robot Screener yet? ===== | ||
+ | |||
+ | It may be due to not having enough screening decisions in your nest. [[: | ||
+ | |||
+ | If you are in Dual Two Pass Screening mode, Robot Screener can currently only be used for Abstract Screening and not Full Text Screening. The requirements must be fulfilled prior to turning on Robot Screener: | ||
+ | |||
+ | * Abstract Screening requires **50** | ||
+ | * These actions must be performed before Robot Screener can be turned on for Abstract Screening | ||