This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
wiki:autolit:screening:robot [2022/07/25 08:10] kholub |
wiki:autolit:screening:robot [2024/03/06 02:40] (current) kevinkallmes |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Robot Screener | + | ===== Guidance on Robot Screener |
- | Robot Screener | + | To clarify, the recommended practice is to **use Robot Screener |
- | ===== Enabling | + | For projects with large numbers of Full Text records, |
- | Robot Screener may be enabled from Screening | + | * Abstract |
+ | * These actions must be performed before | ||
- | * Be configured for dual screening | + | * Full Text Screening requires |
- | * And contain | + | * These actions must be performed before |
- | * And contain **5** | + | |
- | + | ||
- | The latter two requirements help ensure a minimum model accuracy; however, the model will usually be suboptimal with this volume of training data, and typically improves as more records are screened. | + | |
- | + | ||
- | ===== In Action ===== | + | |
- | + | ||
- | ==== Which Records ==== | + | |
- | + | ||
- | Robot Screener automatically adds a reviewer-level screening decision to records with: | + | |
- | + | ||
- | | + | |
- | | + | |
- | + | ||
- | Records it excludes will assigned the exclusion reason '' | + | |
- | + | ||
- | ==== When ==== | + | |
- | + | ||
- | Robot Screener adds/ | + | |
- | + | ||
- | | + | |
- | | + | |
- | * New records | + | |
- | * 10 addditional records have been adjudicated, | + | |
- | + | ||
- | As pointed out above, Robot Screener will not modify its decision on a record after that record has been adjudicated. Prior to adjudication, | + | |
- | + | ||
- | ===== Usage Guidance ===== | + | |
- | + | ||
- | Robot Screener, by accuracy, is not a replacement for a human reviewer. It should typically | + | |
- | + | ||
- | * While Robot Screener may be enabled at 50 adjudicated / 5 included records, we typically advise not enabling it until a cross validation AUC of 0.7 or greater is achieved. | + | |
- | * Avoid use of the " | + | |