Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:autolit:tagging:tag_recommendations

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
wiki:autolit:tagging:tag_recommendations [2024/01/17 17:37]
jthurnham
wiki:autolit:tagging:tag_recommendations [2024/01/27 19:28] (current)
jthurnham [Internal Validation Testing of Abstract Smart Tag Recommendations]
Line 75: Line 75:
 In an internal validation, when compared against expert tagging, Smart Tag Recommendations had recall of approximately 50%-60% across three diverse Systematic Literature Review topics when employing OpenAI's GPT 4 Turbo to tag Abstracts from underlying records. Given the customizability of tags and the distinct content in different reviews, recall and accuracy of Smart Tag Recommendations (for both Abstracts and Full Texts) will vary by project, driving home the need for expert confirmation of any Smart Tag Recommendation. In an internal validation, when compared against expert tagging, Smart Tag Recommendations had recall of approximately 50%-60% across three diverse Systematic Literature Review topics when employing OpenAI's GPT 4 Turbo to tag Abstracts from underlying records. Given the customizability of tags and the distinct content in different reviews, recall and accuracy of Smart Tag Recommendations (for both Abstracts and Full Texts) will vary by project, driving home the need for expert confirmation of any Smart Tag Recommendation.
  
 +==== Guidelines for Optimizing Smart Tag Recommendations ====
 +
 +Check out our [[wiki:autolit:tagging:smart tags guidelines|guidelines for optimizing Smart Tag Recommendations]] and its ability to assist with your review.
 ===== Standard vs Smart Tag Recommendations Example ===== ===== Standard vs Smart Tag Recommendations Example =====
  
wiki/autolit/tagging/tag_recommendations.1705513033.txt.gz ยท Last modified: 2024/01/17 17:37 by jthurnham