Differences

This shows you the differences between two versions of the page.

--- wiki:autolit:tagging:tag [2023/07/12 22:35]
jthurnham [Tags with Table Contents]
+++ wiki:autolit:tagging:tag [2024/05/22 12:20] (current)
jthurnham [Related Report Tags]
@@ Line 1: / Line 1: @@
-====== Applying Tags ======
+====== Applying Tags via Forms ======
-Tags reflect the qualitative content of underlying studies and provide method for attaching text or images from these studies. After tags have been [[:wiki:autolit:tagging:configure|configured]], and so long as at least one study has been included, you can begin applying tags. Once a tag is applied, it is immediately viewable on [[:wiki:synthesis:qualitative|Qualitative Synthesis]].
+Tags reflect the qualitative content of underlying studies and provide method for attaching text or images from these studies. After tags have been [[:wiki:autolit:tagging:configure|configured]], and so long as at least one study has been included, you can begin applying tags. Once a tag is applied, it is immediately viewable on [[:wiki:synthesis:qualitative|]].
-===== Steps for Tagging: =====
+**If you are in Standard Tagging mode, see [[wiki:autolit:tagging:standardtagging|our instructions on how to apply standard tags.]]
+**
+===== Steps for Tagging in Form-based Mode: =====
 ==== 1. Navigate to Tagging ====
 Click the "Tagging" button on the left-hand side, in the Nest Menu.
-{{  :wiki:autolit:tagging:img146.png?nolink&  }}
 This will enable you to apply tags to records sequentially. If you would prefer to search and find records to tag, or to view records that have already been tagged, use [[:wiki:autolit:utilities:inspector|Study Inspector]].
+{{ :undefined:screenshot_2023-12-06_at_20.59.14.png?nolink |}}
 ----
 ==== 2. View the Full Text ====
@@ Line 20: / Line 21: @@
 Click on the "Full Text" toggle in the upper left to view the full-text PDF.
-{{:wiki:autolit:tagging:img147.png?nolink&  }}
+If no full text has yet been imported, learn how to upload it both individually and in bulk [[:wiki:autolit:screening:exclude:fulltext|here]].
-If no full text has yet been imported, learn how to upload it [[:wiki:autolit:screening:exclude:fulltext|here]].
+{{ :undefined:screenshot_2023-12-06_at_20.54.05.png?nolink |}}
 ----
+==== 3. Answering Questions ====
-==== 3. Find the Relevant Tag ====
+Form-based tagging is designed to show the questions you configured side-by-side with the Full Text for ease of data extraction. Questions will be available for answer in the right panel (red box); the Question under review has a **light blue background**, and all Questions should either be answered or marked "Not Relevant".
-As you read through the article and find the relevant tags in the text, tables, or figures, search/select the relevant tag in the drop-down:
+All tags can still be added to the study using Standard Tagging by expanding the Tagging panel (red arrow).
-{{:wiki:autolit:tagging:img148.png?nolink&  }}
+By default, questions are grouped by root tag (highest tag in tag hierarchy) allowing you to select specific groups of questions to answer at a time (blue box). Either select from the drop down or use the arrows to toggle between groups of questions. This is especially helpful if you have a large tag hierarchy and therefore, a single, long form of questions.
-Tags are ordered in the dropdown based on the hierarchy with the leftmost root node at the top, followed by its children, followed by the next root node.
+{{ :undefined:screenshot_2023-11-21_at_12.12.02.png?nolink |}}
-=== 3a. Tag Details ===
+The root tags/groups follow a key to indicate completion of the corresponding group of questions. No circle indicates questions are incomplete, a hollow circle indicates partial completion, and a full circle indicates full completion.
-If you need further details on the tags in order to determine applicability, and if the Tag Description was filled in for the tag in question, you can view it next to the Tag drop-down. An "i" icon will appear next to the Tag if a Description exists, and you can view it upon hovering:
+{{ :undefined:screenshot_2023-11-21_at_12.14.49.png?nolink |}}
-{{:wiki:autolit:tagging:img149.png?nolink&  }}
+However, if you prefer a single form you can change this in Settings:
-=== 3b. Tag Recommendations ===
+{{ :undefined:screenshot_2023-11-21_at_17.02.17.png?nolink |}}
-Regardless of your Tagging mode, there will be a right-hand menu tab titled "Tag Recommendations" beneath either "Tagging" (in Standard mode) or "Questions" (in Form-based mode). Tag Recommendations searches the study full text, highlighting specific text that may be applicable to the tags in your hierarchy. Learn more about how to use [[wiki:autolit:tagging:tag_recommendations|Tag Recommendations.]]
+By adding Answers, you are applying the underlying tag, with the tag content serving as the evidence that the correct Answer(s) have been added. The method of Answering depends on the type of Question, but for all Question types, the tags applied will populate the [[wiki:synthesis:qualitative|Qualitative Synthesis]] in the same manner as Standard Tagging.
+----
+==== Question Type-specific Answers ====
+For each Question in the list, complete the following actions based on the type of Question:
+  * **Single Select:**  Apply one child tag that answers the pre-configured questions. To do so, select one of the tags from the drop-down, and then highlight or select an Excerpt.
+{{ :undefined:screenshot_2023-12-06_at_21.39.13.png?nolink |}}
+  * **Multi-Select:**  Any of the child tags can be an answer, so you can apply as many tags from the drop-down as are applicable to the study. When all relevant child tags are added, select "Next" to mark the Question complete.
+{{ :undefined:screenshot_2023-12-06_at_21.39.47.png?nolink |}}
+  * **Single Apply:**  The tag under review is either applied to the study (select "Apply") or marked irrelevant. No child tags are added!
+{{ :undefined:screenshot_2023-12-06_at_21.40.17.png?nolink |}}
+Whenever a Question has no relevant answers, select "Not Relevant" to move to the next Question.
+----
+===== Tag Recommendations =====
+Tag Recommendations is a tool we offer to speed up the process of data extraction in your nest. The tool searches the study full text and highlights specific evidence within the text to help answer your questions.
+**Standard Tag Recommendations** are available to all users and perform an automatic key word search of the tag name (and any applicable child tags)
+==== Smart Tag Recommendations ====
+//Smart Tag Recommendations// utilize OpenAI's GPT 3.5/4 to perform a smart search of the tag data. Smart Tags can be switched on in Settings and generates recommendations for Abstracts as well as Full Texts.
+If a recommendation is available for the selected question, it will be displayed. When clicked on, it will auto-scroll to the excerpt within the full text and auto-populate in the tag text box to be applied or removed. This tool can be utilized to assist in your systematic evidence collection, and guide targeted reviews as any evidence the AI finds can be applied as a bulk action.
+{{ :undefined:screenshot_2023-12-06_at_22.27.20.png?nolink |}}
+Learn more about how [[wiki:autolit:tagging:tag_recommendations#smart_beta_tag_recommendations_for_enterprise_subscriptions_only|Smart Tag Recommendations work]] and view our [[wiki:support:ai_disclosure|Technical Disclosure on Nested Knowledge AI systems.
+]]
+Note: Smart Tag Recommendations is an enterprise-level feature only. If you wish to conduct a free 2-month pilot trial at the enterprise level in order to make use of this feature in your workflows, please [[mailto: sales@nested-knowledge.com|contact us]] and we'll set that up.
+----
 ==== 4. Add an Annotation ====
@@ Line 52: / Line 93: @@
   * **Selection (Area Annotation):**  A traceable, exact image extraction from a table, figure, or other area of the article.
   * **Manual entry (No Annotation):**  A non-traceable excerpt (that is, an excerpt that is not connected to a specific part of the article) that you type into the Tag Text box.
-You can annotate either before or after selecting the tag of interest in the drop-down (red circle below).
 === 4a. Use the Highlighting Tool: ===
-{{:wiki:autolit:tagging:img150.png?nolink&  }}
+The default Tag Text method is Highlighting. You can also manually select the Highlighting icon, if you need to toggle back to this option.
-The default Tag Text method is Highlighting. You can also manually select the Highlighting icon (see red arrow above), if you need to toggle back to this option.
+Click and drag over the text you would like to Highlight. Highlighting will extract an exact text excerpt that is shown in light blue, and the text will be automatically populated to the Tag Text box.
-Click and drag over the text you would like to Highlight. Highlighting will extract an exact text excerpt that is shown in light blue (see red arrow below), and the text will be automatically populated to the Tag Text box (red outline below).
+{{ :undefined:screenshot_2023-12-06_at_21.45.41.png?nolink |}}
-{{:wiki:autolit:tagging:img151.png?nolink&  }}
 === 4b. Use the Select Tool: ===
-To switch from the default Highlighting tool to the Select tool, click the middle icon above the full text (see red arrow in the top menu below).
+To switch from the default Highlighting tool to the Select tool (middle icon above)
-{{:wiki:autolit:tagging:img152.png?nolink&  }}
+Create a box across the area you'd like to select for the tag. Click in the left-hand corner of your area of interest and drag across the text or table. This selection will be automatically saved in the tag text box.
-Create a box across the area you'd like to select for the tag (red arrow in the text section). Click in the left-hand corner of your area of interest and drag across the text or table. This selection will be automatically saved in the tag text box.
 Selection / Area Annotation is best used on tables, figures, and images that are not amenable to exact text quotation.
+{{ :undefined:screenshot_2023-12-06_at_21.46.13.png?nolink |}}
 === 4c. Manually type out in Tag text box: ===
 If you prefer to manually type the information from the text, you can do this by clicking your cursor in the tag text box and type what you'd like.
-{{:wiki:autolit:tagging:img153.png?nolink&  }}
 Manual text entry should be used whenever you want to associate customized text rather than quotation from the underlying article. **Warning:**  manual entry will not maintain an exact location in the full text, so it may be difficult to find the exact contents of the article that support manually entered text excerpts.
+To select text manually (without highlight) select the right-most cursor icon (circled in below screenshot in blue).
 === Clear Annotations ===
-If you need to redo your tag text annotation, you can either simply redo the action (Highlighting, Selecting, or Manually typing), or select "Clear Annotation" from the top of the Full Text:
+If you need to redo your tag text annotation, you can either simply redo the action (Highlighting, Selecting, or Manually typing), or select "Clear Annotation" from the top of the Full Text (left-most x icon).
-{{:wiki:autolit:tagging:img154.png?nolink&  }}
 This will remove all tag text; next, choose the tag text type you would like to use, and redo the relevant Highlight, Selection, or Manual text entry.
+{{ :undefined:screenshot_2023-12-06_at_21.46.43.png?nolink |}}
 <WRAP center round info 60%> Q: Why not leave the annotation / tag text blank?
@@ Line 95: / Line 133: @@
-==== 5. Click "Apply Tag" ====
+=== 5. Click "Apply Tag" ===
 Once you have the content of interest into the tag text box, make sure that you have selected the relevant tag from the drop-down menu (red box). Once you have confirmed that both the Tag and the Tag Text Content are correct, click "Apply Tag."
-{{:wiki:autolit:tagging:img155.png?nolink&  }}
+{{ :undefined:screenshot_2023-12-06_at_21.48.46.png?nolink |}}
-**Note:** Anytime there is a module box with the adjustable icon, you can drag to adjust the width of the box depending on your preference.
+===== Add New Tags on the Fly =====
-{{  :wiki:autolit:tagging:width_tag.png?nolink&  }}
+If you encounter a single or multiple select question where the answer is not one of your pre-configured tags, you can either add it to your hierarchy on the Configure Tagging page, or add it 'on the fly' without leaving the page.
-==== Tags with Table Contents ====
+To add a tag on the fly, type the title of your new tag answer into the "Select Tag" box, and click "Add Option" that appears at the top of the drop-down list of tags.
-Similarly to tags with text contents, you select the dropdown to find the tag of choice. When selected, the table you created will be shown and you can input text into any of the rows. When you are satisfied, click "Apply Tag."
+{{ :undefined:screenshot_2023-12-06_at_21.56.36.png?nolink |}}
-{{ :undefined:ta.png?nolink |}}
+In the modal that appears, confirm the tag name, add a description (optional), and the parent tag will already be assigned. Once created, you will now be able to find the new Tag on the drop-down list.
+Note: Only tags with text contents can be created on the fly. To toggle on table contents, edit the tag in Configure Tagging.
+===== Tags with Table Contents =====
+By default, all tags to be applied are accompanied by text contents unless table contents are configured. When these tags are encountered within the form, the table you created will be shown and you can input text into any of the rows. When you are satisfied, click "Apply Tag."
+{{ :undefined:screenshot_2023-12-06_at_21.53.39.png?nolink |}}
 Highlighting pdfs does not automatically input the text into the box unlike tags with text contents only. However, it will remember any text highlighted or selected in the pdf and auto-scroll to it when the tag is selected again.
@@ Line 115: / Line 161: @@
 Note: If you are entering numerical data into tables, no automated statistics are generated. This is only done in the Meta-Analytical Extraction module.
-To alter the columns in the table for this tag, head back to Configure Tagging. [[wiki:autolit:tagging:tagtables|Learn more about tag tables here.]]
+To alter the columns in the table for this tag, either click on the column header in the Tagging module itself, or head back to Configure Tagging. [[wiki:autolit:tagging:tagtables|Learn more about tag tables here.]]
-==== Add New Tags on the Fly ====
-When you find a term that you want to add to the Tag Hierarchy, you can either add it on the Configure Tagging page, or add it 'on the fly' without leaving the page.
+===== Tagging Supplemental Materials =====
-To add a tag on the fly, type the title of your new tag into the "Select Tag" box, and click "Add Option" that appears at the top of the drop-down list of tags.
+If the study you are tagging has supplemental materials in pdf format, you may also apply tags to these texts. The functionality is the same as tagging full texts: automatic copy of text to clipboard and text box, text highlighting and area selection allowing immediate direction to the excerpt when the tag is selected etc.
-{{:wiki:autolit:tagging:screenshot_2022-05-25_093901.png}}
+Note: Tag Recommendations are currently unavailable for supplemental pdfs.
-In the modal that appears, confirm the tag name, add a description (optional), and as relevant, identify the new tag's Parent Tag. Once created, you will now be able to find the new Tag on the drop-down list.
+{{ :undefined:screenshot_2023-12-06_at_21.50.34.png?nolink |}}
-Note: Only tags with text contents can be created on the fly. To toggle on table contents, edit the tag in Configure Tagging.
+===== What Answering a Question does =====
+When a Question is finished (Applied or, for Multi-Select, when you select "Next"), or when the Question is marked Not Relevant, the count of completed Questions at the top of the right panel will update.
+When all Questions are finished, you can either add tags using the Standard method (by opening the Tagging panel), or you can move to the next study by selecting "Complete" in the upper right-hand corner.
+===== Related Report Tags =====
+When you apply a tag to a record that has an associated related report (RR), the tag is also displayed on the related report but with a RR icon to differentiate the tag origin. Learn more about [[wiki:autolit:screening:relatedreports#tags_in_related_reports|related report tags.]]
+===== Download Annotated Full Texts/PDFs =====
+After completing Tagging, you may wish to download an annotated version of the full text. To do so, you can [[wiki:autolit:utilities:inspector#download_individual_study_pdfs|download individual annotated pdfs]] or [[wiki:autolit:utilities:inspector:pdfexport|download them in bulk.]]

Nested Knowledge

User Tools

Site Tools

Differences

Page Tools