Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:tagging:tag

This is an old revision of the document!


Applying Tags

Tags reflect the qualitative content of underlying studies and provide method for attaching text or images from these studies. After tags have been configured, and so long as at least one study has been included, you can begin applying tags. Once a tag is applied, it is immediately viewable on Qualitative Synthesis.

Steps for Tagging:

Click the “Tagging” button on the left-hand side, in the Nest Menu.

This will enable you to apply tags to records sequentially. If you would prefer to search and find records to tag, or to view records that have already been tagged, use Study Inspector.


2. View the Full Text

Click on the “Full Text” toggle in the upper left to view the full-text PDF.

If no full text has yet been imported, learn how to upload it here.


3. Find the Relevant Tag

As you read through the article and find the relevant tags in the text, tables, or figures, search/select the relevant tag in the drop-down:

Tags are ordered in the dropdown based on the hierarchy with the leftmost root node at the top, followed by its children, followed by the next root node.

3a. Tag Details

If you need further details on the tags in order to determine applicability, and if the Tag Description was filled in for the tag in question, you can view it next to the Tag drop-down. An “i” icon will appear next to the Tag if a Description exists, and you can view it upon hovering:

3b. Tag Recommendations

Standard Tag Recommendations

Nested Knowledge automatically generates Tag Recommendations for every included study in both Standard and Form-based modes. Once you have uploaded the Full Text, you can apply tags as described above; however, you can also open the Tag Recommendations in the panel to the right of the full text.

Doing so will open a list of the most frequently-occurring tags, which are auto-searched by key word look up across the whole full text:

To view the text that is associated with a given Tag Recommendation, click on the recommendation you're interested in. This will:

  • Auto-jump the PDF to the relevant section,
  • Put the tag name in the Search bar in the top left (underlined in red above), which also displays the number of occurrences of your tag,
  • Highlight the text portion relevant to the recommended tag (red arrows above).

If you want to see all locations the tag occurs in the full text, you can scroll through and find relevant text contents by clicking the arrows on the Search bar.

When you are ready to apply a Tag Recommendation, all you need to do is:

  • Click on it,
  • Select the text content of interest (using the techniques outlined below).

Once added, the Tag Recommendation will disappear from the Tag Recommendations list and appear as an applied Tag.

Smart (Beta) Tag Recommendations (for Enterprise subscriptions only)

Smart Tag Recommendations are an upgraded version of the above tag recommendations since it utilizes GPT 4, a language model provided by OpenAI, to search for tags and automatically highlight corresponding excerpts. Instead of searching the full text for key words alone, Smart Tag Recommendations uses artificial intelligence to search for similar or applicable terms and/or specific answers to your form-based questions. Compatible with Standard and Form-based Tagging modes, you can toggle on this feature in Admin Settings, provided you have an Enterprise subscription.

After toggling on Smart Tag Recommendations, the feature runs in the background to update all recommendations currently in the Tagging queue. This currently takes around 1-2 minutes per study, so it can take some time for recommendations to be generated if you have a large number of included studies. It will also automatically update when new studies are added to the queue.

Once updated, a list of tag recommendations will be shown. Similarly to Standard Tag Recommendations, clicking on any recommendation will auto-fill the excerpt box, auto-jump you to the area of the pdf based on the AI's findings and you can apply tags as normal. Below, the recommendation for “Disease Symptom Scores” was selected. You can apply tag or clear the selection if you do not wish to apply with this excerpt.

Wondering why Smart Tag Recommendations is unavailable? You may not currently have access due to your subscription type. Upgrade to an Enterprise subscription to access Smart Tag Recommendations. If this is not the case, it may be because it has not yet been toggled on, head to Settings and follow the instructions above. If neither of these are applicable, contact us support@nested-knowledge.com

4. Add an Annotation

To associate text content with a tag, identify this text either before or after selecting the tag from the drop-down. You have three options for how to identify the text excerpt that will be associated with that tag:

  • Highlighting (Text Annotation): A traceable, exact quote from the text of the article.
  • Selection (Area Annotation): A traceable, exact image extraction from a table, figure, or other area of the article.
  • Manual entry (No Annotation): A non-traceable excerpt (that is, an excerpt that is not connected to a specific part of the article) that you type into the Tag Text box.

You can annotate either before or after selecting the tag of interest in the drop-down (red circle below).

4a. Use the Highlighting Tool:

The default Tag Text method is Highlighting. You can also manually select the Highlighting icon (see red arrow above), if you need to toggle back to this option.

Click and drag over the text you would like to Highlight. Highlighting will extract an exact text excerpt that is shown in light blue (see red arrow below), and the text will be automatically populated to the Tag Text box (red outline below).

4b. Use the Select Tool:

To switch from the default Highlighting tool to the Select tool, click the middle icon above the full text (see red arrow in the top menu below).

Create a box across the area you'd like to select for the tag (red arrow in the text section). Click in the left-hand corner of your area of interest and drag across the text or table. This selection will be automatically saved in the tag text box.

Selection / Area Annotation is best used on tables, figures, and images that are not amenable to exact text quotation.

4c. Manually type out in Tag text box:

If you prefer to manually type the information from the text, you can do this by clicking your cursor in the tag text box and type what you'd like.

Manual text entry should be used whenever you want to associate customized text rather than quotation from the underlying article. Warning: manual entry will not maintain an exact location in the full text, so it may be difficult to find the exact contents of the article that support manually entered text excerpts.

Clear Annotations

If you need to redo your tag text annotation, you can either simply redo the action (Highlighting, Selecting, or Manually typing), or select “Clear Annotation” from the top of the Full Text:

This will remove all tag text; next, choose the tag text type you would like to use, and redo the relevant Highlight, Selection, or Manual text entry.

Q: Why not leave the annotation / tag text blank?

A: It is possible to apply tags without filling in the tag text. However, doing so will mean that the only evidence that the tag is applicable to that specific study will be the fact that it was applied, and those who view your Qualitative Synthesis will have no context. If you fill in text content, you provide specific evidence of that tag's applicability as well as presenting the specific information from that study to viewers of Qualitative Synthesis.

5. Click "Apply Tag"

Once you have the content of interest into the tag text box, make sure that you have selected the relevant tag from the drop-down menu (red box). Once you have confirmed that both the Tag and the Tag Text Content are correct, click “Apply Tag.”

Note: Anytime there is a module box with the adjustable icon, you can drag to adjust the width of the box depending on your preference.

Tags with Table Contents

Similarly to tags with text contents, you select the dropdown to find the tag of choice. When selected, the table you created will be shown and you can input text into any of the rows. When you are satisfied, click “Apply Tag.”

Highlighting pdfs does not automatically input the text into the box unlike tags with text contents only. However, it will remember any text highlighted or selected in the pdf and auto-scroll to it when the tag is selected again.

Note: If you are entering numerical data into tables, no automated statistics are generated. This is only done in the Meta-Analytical Extraction module.

Add New Tags on the Fly

When you find a term that you want to add to the Tag Hierarchy, you can either add it on the Configure Tagging page, or add it 'on the fly' without leaving the page.

To add a tag on the fly, type the title of your new tag into the “Select Tag” box, and click “Add Option” that appears at the top of the drop-down list of tags.

In the modal that appears, confirm the tag name, add a description (optional), and as relevant, identify the new tag's Parent Tag. Once created, you will now be able to find the new Tag on the drop-down list.

Note: Only tags with text contents can be created on the fly. To toggle on table contents, edit the tag in Configure Tagging.

wiki/autolit/tagging/tag.1689090247.txt.gz · Last modified: 2023/07/11 15:44 by jthurnham