Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:screening:robot

This is an old revision of the document!


Robot Screener

Robot Screener is an automated replacement for one of the human reviewers traditionally involved in dual screening.

Enabling Robot Screener

Robot Screener may be enabled from Screening Settings, under “Inclusion Modeling”. Before Robot Screener can be enabled, the nest must:

  • Be configured for dual screening
  • And contain 50 adjudicated records (i.e. having a final screening decision)
  • And contain 5 included records

The latter two requirements ensure a minimum model accuracy; however, the model will be suboptimal with this volume of training data, and typically improves as more records are screened.

In Action

Which Records

Robot Screener automatically adds a reviewer-level screening decision to records with:

  • Fewer than 2 reviewer-level screening decisions
  • No adjudicated screening decision

Records it excludes will exclusively be assigned the exclusion reason Robot Excluded

When

Robot Screener adds/updates its screening decisions when:

  • Robot Screener is enabled
  • A new inclusion model is trained
  • New records are imported into your nest
  • 10 addditional records have been adjudicated, since the model was last trained

As pointed out above, Robot Screener will not modify its decision on a record after that record has been adjudicated. Prior to adjudication, its decision on a record may be modified, reflecting more information available to it & improvement in its accuracy.

wiki/autolit/screening/robot.1658735856.txt.gz · Last modified: 2022/07/25 07:57 by kholub