This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
wiki:autolit:screening:robot [2023/04/10 17:18] jthurnham [Enabling Robot Screener] |
wiki:autolit:screening:robot [2024/06/10 19:38] kevinkallmes |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Robot Screener | + | ===== Guidance on Robot Screener |
- | Robot Screener | + | The recommended practice is to **use Robot Screener |
- | ===== Enabling | + | * Abstract Screening requires **50** |
+ | * These actions must be performed before | ||
- | Robot Screener may be enabled from Screening Settings, under " | + | |
- | + | * You can keep Robot Screener | |
- | | + | |
- | * And contain **50** | + | |
- | * And contain **5** included records | + | |
- | + | ||
- | The latter two requirements help ensure a minimum model accuracy; however, the model will usually be suboptimal with this volume of training data, and typically improves as more records | + | |
- | + | ||
- | By enabling Robot Screener, automatic updating to the inclusion model is made non-optional, as is the hiding of inclusion probabilities. This avoids biasing human reviewers with data already being used by Robot Screener. | + | |
- | + | ||
- | ===== In Action ===== | + | |
- | + | ||
- | ==== Which Records ==== | + | |
- | + | ||
- | Robot Screener | + | |
- | + | ||
- | * Fewer than 2 reviewer-level screening decisions | + | |
- | * No adjudicated screening decision | + | |
- | + | ||
- | Records it excludes will assigned the exclusion reason | + | |
- | + | ||
- | ==== When ==== | + | |
- | + | ||
- | Robot Screener adds/ | + | |
- | + | ||
- | * Robot Screener is enabled | + | |
- | * A new inclusion model is trained | + | |
- | * New records are imported into your nest | + | |
- | * 10 addditional records have been adjudicated, since the model was last trained | + | |
- | + | ||
- | As pointed out above, Robot Screener will not modify its decision on a record | + | |
- | + | ||
- | ===== Usage Guidance ===== | + | |
- | + | ||
- | Robot Screener, | + | |
- | + | ||
- | * While Robot Screener may be enabled at 50 adjudicated / 5 included records, we typically advise not enabling it until a cross validation AUC of 0.7 or greater is achieved. | + | |
- | * Avoid use of the " | + | |