This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
wiki:autolit:tagging:tag_recommendations [2023/12/12 19:42] kevinkallmes [Regenerating Smart Tag Recommendations and Error Reporting] |
wiki:autolit:tagging:tag_recommendations [2024/01/17 17:37] jthurnham |
||
---|---|---|---|
Line 2: | Line 2: | ||
There are two Tag Recommendation modes: Standard and Smart (Beta). In short, **standard tag recommendations** use keyword searches and is available to all users while **Smart Tag Recommendations** uses OpenAI, a Large Language Model that can read and answer questions, but is //only available to enterprise customers.// | There are two Tag Recommendation modes: Standard and Smart (Beta). In short, **standard tag recommendations** use keyword searches and is available to all users while **Smart Tag Recommendations** uses OpenAI, a Large Language Model that can read and answer questions, but is //only available to enterprise customers.// | ||
- | |||
===== Standard Tag Recommendations ===== | ===== Standard Tag Recommendations ===== | ||
Nested Knowledge automatically generates Standard Tag Recommendations for every included study. These are available for Full Texts (by default) but you may also turn on Abstract Tag Recommendations in Settings. | Nested Knowledge automatically generates Standard Tag Recommendations for every included study. These are available for Full Texts (by default) but you may also turn on Abstract Tag Recommendations in Settings. | ||
- | {{ : | + | {{ : |
==== Standard Tag Recs: Full Text ==== | ==== Standard Tag Recs: Full Text ==== | ||
Line 15: | Line 14: | ||
Form-based appearance: | Form-based appearance: | ||
- | {{ : | + | {{ : |
Standard appearance: | Standard appearance: | ||
- | {{ : | + | {{ : |
To view the text that is associated with a given Tag Recommendation, | To view the text that is associated with a given Tag Recommendation, | ||
Line 40: | Line 39: | ||
Similarly, when standard tag recommendations for abstracts is turned on, any recommendations will be highlighted in blue when clicked on. | Similarly, when standard tag recommendations for abstracts is turned on, any recommendations will be highlighted in blue when clicked on. | ||
- | {{ : | + | {{ : |
==== Aliases ==== | ==== Aliases ==== | ||
Line 47: | Line 45: | ||
If a tag has an alias and the original tag name does not generate any recommendations, | If a tag has an alias and the original tag name does not generate any recommendations, | ||
- | {{ : | + | {{ : |
===== Smart (Beta) Tag Recommendations (for Enterprise subscriptions only) ===== | ===== Smart (Beta) Tag Recommendations (for Enterprise subscriptions only) ===== | ||
Line 68: | Line 67: | ||
==== Abstract Tag Recommendations ==== | ==== Abstract Tag Recommendations ==== | ||
- | In addition to Full Text Smart Tags, for further assistance, you also have the option to turn on Tag Recommendations (both Standard and Smart) for included Abstracts (see Settings). The format is the same as Full Text Smart Tags, but labelled " | + | In addition to Full Text Smart Tags, for further assistance, you also have the option to turn on Tag Recommendations (both Standard and Smart) for included Abstracts (see Settings). The format is the same as Full Text Smart Tags, but labelled " |
{{ : | {{ : | ||
+ | |||
+ | ==== Internal Validation Testing of Abstract Smart Tag Recommendations ==== | ||
+ | |||
+ | In an internal validation, when compared against expert tagging, Smart Tag Recommendations had recall of approximately 50%-60% across three diverse Systematic Literature Review topics when employing OpenAI' | ||
===== Standard vs Smart Tag Recommendations Example ===== | ===== Standard vs Smart Tag Recommendations Example ===== | ||
Line 92: | Line 95: | ||
Additionally, | Additionally, | ||
+ | ===== Tag Recommendations in Screening Module ===== | ||
- | ==== Abstract | + | Tag recommendations are also displayed in the Screening module. When viewing |
- | + | ||
- | + | ||
- | In addition to Full Text Smart Tags, for further assistance, you also have the option to turn on Tag Recommendations (both Standard and Smart) for included Abstracts (see Settings). The format is the same as Full Text Smart Tags, but labelled " | + | |
- | + | ||
- | {{ : | + | |
- | + | ||
- | ===== Standard vs Smart Tag Recommendations Example ===== | + | |
- | + | ||
- | In Standard mode, only the tag name is searched | + | |
- | + | ||
- | {{ : | + | |
- | + | ||
- | However, in Smart mode, a deeper dive is conducted. The AI was able to correctly identify the section where all the lesions were located, auto-selecting " | + | |
- | + | ||
- | {{ : | + | |
- | ==== Regenerating Smart Tag Recommendations and Error Reporting ==== | + | |
- | + | ||
- | If you make changes to your tag hierarchy or switched tagging modes after turning on Smart Tag Recommendations, | + | |
- | + | ||
- | Since the use of OpenAI for tag recommendations is in its beta phase, meaning it is technically feature complete but still in its early stages, there is a possibility you may run into errors. Be sure to [[https:// | + | |
- | + | ||
- | <WRAP center round info 60%> Wondering why Smart Tag Recommendations is unavailable or blank? You may not currently have access due to your subscription type. Upgrade to an Enterprise subscription to access Smart Tag Recommendations and toggle | + | |
+ | {{ : | ||