Differences

This shows you the differences between two versions of the page.

--- wiki:autolit:tagging:tag_recommendations [2023/11/21 11:46]
jthurnham [Smart (Beta) Tag Recommendations (for Enterprise subscriptions only)]
+++ wiki:autolit:tagging:tag_recommendations [2024/01/02 16:51]
kevinkallmes [Abstract Tag Recommendations]
@@ Line 71: / Line 71: @@
 {{  :undefined:screenshot_2023-10-02_at_16.51.19.png?nolink&  }}
+==== Internal Validation Testing of Abstract Smart Tag Recommendations ====
+In an internal validation, when compared against expert tagging, Smart Tag Recommendations had recall of approximately 50%-60% across three diverse Systematic Literature Review topics when employing OpenAI's GPT 4 Turbo to tag Abstracts from underlying records. Given the customizability of tags and the distinct content in different reviews, recall and accuracy of Smart Tag Recommendations (for both Abstracts and Full Texts) will vary by project, driving home the need for expert confirmation of any Smart Tag Recommendation.
 ===== Standard vs Smart Tag Recommendations Example =====
@@ Line 89: / Line 94: @@
 <WRAP center round info 60%> Wondering why Smart Tag Recommendations is unavailable or blank? You may not currently have access due to your subscription type. Upgrade to an Enterprise subscription to access Smart Tag Recommendations and toggle on in Settings. If this is not the case, it may be because it hasn't finished loading yet, check background jobs in the top right. Lastly, the feature may just not have any recommendations for that particular tag or question, try a clicking on a few more and see if it works! If none of these are applicable, contact us [[support@nested-knowledge.com|support@nested-knowledge.com]] </WRAP>
+Additionally, when generating new recommendations for identical or similar questions (within or between nests), a certain level of change in the recommendations should be expected. This is because GPT-4 is nondeterministic, due to how it parallelizes floating point arithmetic for performance.

Nested Knowledge

User Tools

Site Tools

Differences

Page Tools