This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
wiki:autolit:tagging:tag_recommendations [2023/07/12 04:53] jthurnham [Smart (Beta) Tag Recommendations (for Enterprise subscriptions only)] |
wiki:autolit:tagging:tag_recommendations [2024/01/17 17:31] jthurnham |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== Tag Recommendations ====== | ====== Tag Recommendations ====== | ||
- | There are two Tag Recommendation modes: Standard and Smart (Beta). In short, standard tag recommendations use keyword searches and is available to all users while Smart Tag Recommendations uses OpenAI | + | There are two Tag Recommendation modes: Standard and Smart (Beta). In short, |
===== Standard Tag Recommendations ===== | ===== Standard Tag Recommendations ===== | ||
- | Whether your nest is in Standard or Form-based tagging mode, Nested Knowledge automatically generates Standard Tag Recommendations for every included study. | + | Nested Knowledge automatically generates Standard Tag Recommendations for every included study. |
- | Doing so will open a list of the most frequently-occurring tags, which are auto-searched by key word look up across the whole full text: | + | {{ : |
- | {{:wiki:autolit:tagging:untitled_12.png}} | + | ==== Standard Tag Recs: Full Text ==== |
+ | |||
+ | Once you have uploaded the Full Text, standard tag recommendations will become available. To view them, open the "Full Text Tag Recs" tab on the right hand side, and Standard should be toggled by default. Doing so will open a list of tag recommendations, | ||
+ | |||
+ | Form-based appearance: | ||
+ | |||
+ | {{ :undefined:screenshot_2023-11-02_at_14.30.05.png? | ||
+ | |||
+ | Standard appearance: | ||
+ | |||
+ | {{ | ||
To view the text that is associated with a given Tag Recommendation, | To view the text that is associated with a given Tag Recommendation, | ||
Line 25: | Line 34: | ||
Once added, the Tag Recommendation will disappear from the Tag Recommendations list and appear as an applied Tag. | Once added, the Tag Recommendation will disappear from the Tag Recommendations list and appear as an applied Tag. | ||
+ | |||
+ | ==== Standard Tag Recs: Abstracts ==== | ||
+ | |||
+ | Similarly, when standard tag recommendations for abstracts is turned on, any recommendations will be highlighted in blue when clicked on. | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | ==== Aliases ==== | ||
+ | |||
+ | If a tag has an alias and the original tag name does not generate any recommendations, | ||
+ | |||
+ | {{ : | ||
===== Smart (Beta) Tag Recommendations (for Enterprise subscriptions only) ===== | ===== Smart (Beta) Tag Recommendations (for Enterprise subscriptions only) ===== | ||
- | Smart Tag Recommendations | + | <WRAP center round box 80%> Introducing Nested Knowledge' |
- | {{ | + | Smart Tag Recommendations are an upgraded version of the above tag recommendations that utilizes GPT 4, a language model provided by OpenAI, to search for tags and automatically highlight corresponding excerpts. To see a full disclosure of what data Smart Tag Recommendations use and how it works, see the [[:wiki:support:ai_disclosure# |
- | After toggling on Smart Tag Recommendations, | + | Unlike " |
+ | |||
+ | {{ : | ||
+ | |||
+ | After toggling on Smart Tag Recommendations, | ||
Once updated, a list of tag recommendations will be shown. Similarly to Standard Tag Recommendations, | Once updated, a list of tag recommendations will be shown. Similarly to Standard Tag Recommendations, | ||
Line 40: | Line 65: | ||
In Form-based Tagging mode, selecting a tag recommendation will populate the answer to the question for you as well as auto-highlighting in the full text. | In Form-based Tagging mode, selecting a tag recommendation will populate the answer to the question for you as well as auto-highlighting in the full text. | ||
- | ===== Standard vs Smart Tag Recommendations ===== | + | ==== Abstract Tag Recommendations ==== |
+ | |||
+ | In addition to Full Text Smart Tags, for further assistance, you also have the option to turn on Tag Recommendations (both Standard and Smart) for included Abstracts (see Settings). The format is the same as Full Text Smart Tags, but labelled " | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | ==== Internal Validation Testing of Abstract Smart Tag Recommendations ==== | ||
+ | |||
+ | In an internal validation, when compared against expert tagging, Smart Tag Recommendations had recall of approximately 50%-60% across three diverse Systematic Literature Review topics when employing OpenAI' | ||
+ | |||
+ | ===== Standard vs Smart Tag Recommendations | ||
+ | |||
+ | In Standard mode, only the tag name is searched in the full text. In Smart mode, GPT 4 uses similarly reported terms to find the most applicable excerpt. In the below example, for the question "Where are the lesions located?", | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | However, in Smart mode, a deeper dive is conducted. The AI was able to correctly identify the section where all the lesions were located, auto-selecting " | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | ==== Regenerating Smart Tag Recommendations and Error Reporting ==== | ||
+ | |||
+ | If you make changes to your tag hierarchy or switched tagging modes after turning on Smart Tag Recommendations, | ||
+ | |||
+ | Since the use of OpenAI for tag recommendations is in its beta phase, meaning it is technically feature complete but still in its early stages, there is a possibility you may run into errors. Be sure to [[https:// | ||
+ | |||
+ | <WRAP center round info 60%> Wondering why Smart Tag Recommendations is unavailable or blank? You may not currently have access due to your subscription type. Upgrade to an Enterprise subscription to access Smart Tag Recommendations and toggle on in Settings. If this is not the case, it may be because it hasn't finished loading yet, check background jobs in the top right. Lastly, the feature may just not have any recommendations for that particular tag or question, try a clicking on a few more and see if it works! If none of these are applicable, contact us [[support@nested-knowledge.com|support@nested-knowledge.com]] </ | ||
+ | |||
+ | Additionally, | ||
+ | |||
+ | ==== Abstract Tag Recommendations ==== | ||
+ | |||
+ | In addition to Full Text Smart Tags, for further assistance, you also have the option to turn on Tag Recommendations (both Standard and Smart) for included Abstracts (see Settings). The format is the same as Full Text Smart Tags, but labelled " | ||
+ | |||
+ | {{ : | ||
+ | |||
+ | ===== Standard vs Smart Tag Recommendations Example ===== | ||
+ | |||
+ | In Standard mode, only the tag name is searched in the full text. In Smart mode, GPT 4 uses similarly reported terms to find the most applicable excerpt. In the below example, for the question "Where are the lesions located?", | ||
- | In Standard mode, only the tag name is searched in the full text. In Smart mode, GPT 4 uses similarly reported terms to find the most applicable excerpt. In the below example, for the question "Where are the lesions located?", Standard mode only searches the tag answers: "ICA terminus" | + | {{ : |
However, in Smart mode, a deeper dive is conducted. The AI was able to correctly identify the section where all the lesions were located, auto-selecting " | However, in Smart mode, a deeper dive is conducted. The AI was able to correctly identify the section where all the lesions were located, auto-selecting " | ||
+ | {{ : | ||
- | ==== Regenerating Smart Tag Recommendations ==== | + | ==== Regenerating Smart Tag Recommendations |
If you make changes to your tag hierarchy or switched tagging modes after turning on Smart Tag Recommendations, | If you make changes to your tag hierarchy or switched tagging modes after turning on Smart Tag Recommendations, |