Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:guide:research:screen

This is an old revision of the document!


Screening Your References (Study Selection)

After running your search through one or more databases, the next step is to screen through the results to decide which studies you want to include.

Selecting Exclusion Criteria

Exclusion criteria should be determined before screening begins. Common exclusion criteria include publication prior to a specific date, articles not written in English, the wrong type of article (meta-analysis/systematic review, editorial, correspondence, letter to the editor, abstracts), the wrong type of study (in vitro and in vivo studies, retrospective study, cohort study, case series, case study), and too few patients (for example, fewer than 10).

Additional exclusion criteria often relate to PICO. Examples include the following: incorrect target population for the study, an intervention of interest that was not performed at the time of interest, single-arm (no comparator) studies, and no reporting of outcomes of interest.


Screening Steps

* Before going through each study, begin by removing any duplicates with the Nested Knowledge software.

* When reading the title and abstract to determine whether a study should be included, check each of the inclusion and exclusion criteria and the elements of PICO. If there are not enough details in the abstract, mark this study for full-text review. For studies that don’t meet the inclusion criteria, mark them as excluded and note the reason they were excluded. Be sure to note any recurring exclusion reasons that were not determined beforehand.

* After the initial round of screening is complete, go back through the remaining included studies and locate the full text for each. A great resource for finding full text is Sci-Hub.

* When looking through a PDF of a study, use “Ctrl F” to find specific words or phrases to quickly locate the elements of PICO to quickly find essential information. The remaining included studies will go on to have their data tagged and extracted for analysis.


Should You Exclude Follow-up Studies?

It is generally better to include the primary study over post-hoc and follow-up studies. However, there are times when the post-hoc study is more relevant than the primary study. As long as you are only collecting data on each patient once, the follow-up study may be included.


Is Dual Screening Necessary?

Dual screening is a process where two reviewers independently screen the search results making decisions about whether to include or exclude articles. Discrepancies are usually discussed before a final decision is made. Although this may take more time, the advantage is greater accuracy. 1 2 3

The choice of whether to dual-screen or not should be discussed by the team. One study showed that single-reviewer abstract screening missed 13% of relevant studies, while dual-reviewer screening missed 3%.1 Another analysis found a total reviewer error rate (false inclusion and false exclusion) of 10.76%.2

This article provides some alternatives to dual screening.


References

  1. Gartlehner G, Affengruber L, Titscher V, Noel-Storr A, Dooley G, Ballarini N, König F. Single-reviewer abstract screening missed 13 percent of relevant studies: a crowd-based, randomized controlled trial. J Clin Epidemiol. 2020 May;121:20-28. doi: 10.1016/j.jclinepi.2020.01.005. Epub 2020 Jan 21. PMID: 31972274.
  2. Wang Z, Nayfeh T, Tetzlaff J, O'Blenis P, Murad MH. Error rates of human reviewers during abstract screening in systematic reviews. PLoS One. 2020 Jan 14;15(1):e0227742. doi: 10.1371/journal.pone.0227742. PMID: 31935267; PMCID: PMC6959565.
  3. Waffenschmidt S, Knelangen M, Sieben W, Bühn S, Pieper D. Single screening versus conventional double screening for study selection in systematic reviews: a methodological systematic review. BMC Med Res Methodol. 2019 Jun 28;19(1):132. doi: 10.1186/s12874-019-0782-0. PMID: 31253092; PMCID: PMC6599339.
wiki/guide/research/screen.1652727044.txt.gz · Last modified: 2022/05/16 18:50 by tiffany