Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:extraction:dual

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
wiki:autolit:extraction:dual [2023/06/27 21:41]
jthurnham removed
— (current)
Line 1: Line 1:
-====== Dual Extraction ====== 
- 
-**Dual Extraction** is a quality-controlled extraction process, where two users independently extract data from each article, and then all data are adjudicated by an Administrator. 
- 
-The Admin adjudicates any disagreement between Reviewer A and Reviewer B and sets the final determination for each study. For example, if Reviewer A extracts the mean age as 70 but Reviewer B extracts it as 71, the Adjudicator will then need to choose between those values and identify the correct one. 
- 
-**//Only those with Admin privileges can serve as Adjudicators, but any user can serve as a Reviewer// ** 
- 
-This feature is useful to ensure that your team curates the most accurate and high qualitly data possible. Dual extraction can help with this since it has been shown that dual extraction results in fewer errors than single extraction. ([[https://pubmed.ncbi.nlm.nih.gov/16765272/|source]]) 
- 
-===== Configure Dual Extraction ===== 
- 
-To configure dual extraction, go to the [[:wiki:autolit:admin:configure|Settings page]] under Nest Home and then scroll to the Extraction section. Then, select dual extraction to turn this feature on. 
- 
-{{:wiki:autolit:extraction:img31.png?nolink&  }} 
- 
-<WRAP center round important 60%> **Warning:** Toggling back from Dual Extraction to Standard Extraction will ONLY save final adjudications, and **all data associated with non-final individual users' extractions will be lost**! </WRAP> 
- 
- 
-===== Dual Extraction Steps ===== 
- 
-==== 1. Two users must independently extract the data. ==== 
- 
-Once Dual Extraction is configured (see above), The software will automatically queue individual studies to users until at least two Extractions are Marked Complete. 
- 
-If you need help with the Extraction process, check out [[:wiki:autolit:extraction:extract|this page]]. Each study will appear in the Adjudicate Extraction queue only after two independent extractions are Marked Complete. 
- 
-<WRAP center round tip 60%> Unlike Standard (single) Extraction, when a user is finished extracting in Dual mode, the data are NOT displayed on Synthesis. In Dual Extraction, data are queued for Adjudication, and displayed on Synthesis only after Adjudication on the study in question is Marked Complete. </WRAP> 
- 
-==== 2. Adjudicate the data ==== 
- 
-Go to the Adjudicate Extraction page to review the data extracted by the two independent, underlying users. At first the page will appear the same as the Dual Extraction page. To view the two independent decisions, expand the right hand tabs by clicking the arrows icon in the left corners. 
- 
-{{:wiki:autolit:extraction:111.png}} 
- 
-This will display three columns: Reviewer A, Reviewer B, and Final. The adjudicator will put the correct data in the Final column, adjudicating differences between the reviewers. Disagreements between reviewers are highlighted in red. The adjudicator can choose to input the same data as either of the reviewers or neither of them if they were both wrong. To enter in data, hit the plus sign and fill in the cells. You may use the arrows icon to toggle between viewing reviewer decisions and the study. When done, to move on to the next study, hit Complete in the top right corner. 
- 
-{{:wiki:autolit:extraction:112.png}} 
-