This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
wiki:autolit:screening:robot [2023/04/10 17:09] jthurnham [Robot Screener] |
— (current) | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Robot Screener ====== | ||
- | |||
- | Robot Screener is //type// of Dual Screening where an automated substitute for one of the human reviewers traditionally involved in dual screening. | ||
- | |||
- | ===== Enabling Robot Screener ===== | ||
- | |||
- | Robot Screener may be enabled from Screening Settings, under " | ||
- | |||
- | * Be configured for dual screening | ||
- | * And contain **50** | ||
- | * And contain **5** included records | ||
- | |||
- | The latter two requirements help ensure a minimum model accuracy; however, the model will usually be suboptimal with this volume of training data, and typically improves as more records are screened. | ||
- | |||
- | By enabling Robot Screener, automatic updating to the inclusion model is made non-optional, | ||
- | |||
- | ===== In Action ===== | ||
- | |||
- | ==== Which Records ==== | ||
- | |||
- | Robot Screener automatically adds a reviewer-level screening decision to records with: | ||
- | |||
- | * Fewer than 2 reviewer-level screening decisions | ||
- | * No adjudicated screening decision | ||
- | |||
- | Records it excludes will assigned the exclusion reason '' | ||
- | |||
- | ==== When ==== | ||
- | |||
- | Robot Screener adds/ | ||
- | |||
- | * Robot Screener is enabled | ||
- | * A new inclusion model is trained | ||
- | * New records are imported into your nest | ||
- | * 10 addditional records have been adjudicated, | ||
- | |||
- | As pointed out above, Robot Screener will not modify its decision on a record after that record has been adjudicated. Prior to adjudication, | ||
- | |||
- | ===== Usage Guidance ===== | ||
- | |||
- | Robot Screener, by accuracy, is not a replacement for a human reviewer. It should typically be used for reviews where budget, team size, or time available are restricted. Some additional usage tips: | ||
- | |||
- | * While Robot Screener may be enabled at 50 adjudicated / 5 included records, we typically advise not enabling it until a cross validation AUC of 0.7 or greater is achieved. | ||
- | * Avoid use of the " | ||
- | |||