Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:tagging:tag_recommendations

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision Both sides next revision
wiki:autolit:tagging:tag_recommendations [2023/12/12 19:42]
kevinkallmes [Regenerating Smart Tag Recommendations and Error Reporting]
wiki:autolit:tagging:tag_recommendations [2024/01/02 16:51]
kevinkallmes [Abstract Tag Recommendations]
Line 71: Line 71:
  
 {{  :undefined:screenshot_2023-10-02_at_16.51.19.png?nolink&  }} {{  :undefined:screenshot_2023-10-02_at_16.51.19.png?nolink&  }}
 +
 +==== Internal Validation Testing of Abstract Smart Tag Recommendations ====
 +
 +In an internal validation, when compared against expert tagging, Smart Tag Recommendations had recall of approximately 50%-60% across three diverse Systematic Literature Review topics when employing OpenAI's GPT 4 Turbo to tag Abstracts from underlying records. Given the customizability of tags and the distinct content in different reviews, recall and accuracy of Smart Tag Recommendations (for both Abstracts and Full Texts) will vary by project, driving home the need for expert confirmation of any Smart Tag Recommendation.
 +
  
 ===== Standard vs Smart Tag Recommendations Example ===== ===== Standard vs Smart Tag Recommendations Example =====
wiki/autolit/tagging/tag_recommendations.txt ยท Last modified: 2024/06/05 13:46 by jthurnham