Skip to content

Commit

Permalink
docs: DOC-232: New LLM templates and reorganizing (#6147)
Browse files Browse the repository at this point in the history
Co-authored-by: caitlinwheeless <[email protected]>
Co-authored-by: Jo Booth <[email protected]>
  • Loading branch information
3 people authored Jul 31, 2024
1 parent d47be87 commit 91ef076
Show file tree
Hide file tree
Showing 25 changed files with 907 additions and 342 deletions.
19 changes: 2 additions & 17 deletions docs/source/templates/gallery_generative_ai.ejs
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
title: Generative AI
title: LLM Fine-tuning
type: templates
order: 1007
meta_title: Gallery of Generative AI Labeling Templates
Expand All @@ -22,25 +22,10 @@ cards:
image: "/images/templates/generative-pairwise-human-preference.png"
url: "/templates/generative-pairwise-human-preference.html"

- title: Chatbot Model Assessment
categories:
- LLM Evaluation
- Chatbot
- Text Generation
image: "/images/templates/generative-chatbot-assessment.png"
url: "/templates/generative-chatbot-assessment.html"

- title: LLM Ranker
- title: RAG Retrieval
categories:
- Ranking
- Retrieval-Augmented Generation
image: "/images/templates/llm-ranker.png"
url: "/templates/generative-llm-ranker.html"

- title: Visual Ranker
categories:
- Ranking
- Retrieval-Augmented Generation
image: "/images/templates/visual-ranker.png"
url: "/templates/generative-visual-ranker.html"
---
44 changes: 44 additions & 0 deletions docs/source/templates/gallery_llm_evals.ejs
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
---
title: LLM Evaluations
type: templates
order: 1008
meta_title: Gallery of Labeling Templates for LLM Evaluation
meta_description: Gallery of templates available to perform data labeling and annotation tasks with Label Studio for your machine learning model and data science projects.
layout: templates
cards:
- title: LLM Response Moderation
categories:
- LLM evaluation
- Text classification
image: "/images/templates/response-moderation.png"
url: "/templates/llm_response_moderation.html"

- title: LLM Response Grading
categories:
- LLM evaluation
- Text Classification
image: "/images/templates/response-grading.png"
url: "/templates/llm_response_grading.html"

- title: Side-by-Side LLM Output Comparison
categories:
- Ranking
- Retrieval-Augmented Generation
image: "/images/templates/side-by-side-comparison.png"
url: "/templates/llm_side_by_side.html"

- title: Evaluate RAG with Human Feedback
categories:
- Response Evaluation
- Retrieval-Augmented Generation
image: "/images/templates/evaluate-rag-human-feedback.png"
url: "/templates/llm_rag_human_feedback.html"

- title: Evaluate RAG with Ragas
categories:
- Response Evaluation
- Ragas
- Retrieval-Augmented Generation
image: "/images/templates/evaluate-rag-automated-metrics.png"
url: "/templates/llm_ragas.html"
---
7 changes: 7 additions & 0 deletions docs/source/templates/gallery_rns.html
Original file line number Diff line number Diff line change
Expand Up @@ -41,4 +41,11 @@
image: "/images/templates-misc/website-rating.png"
url: "/templates/website_rating.html"

- title: Visual Ranker
categories:
- Ranking
- Retrieval-Augmented Generation
image: "/images/templates/visual-ranker.png"
url: "/templates/generative-visual-ranker.html"

---
2 changes: 1 addition & 1 deletion docs/source/templates/gallery_videos.ejs
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
title: Videos
type: templates
order: 1007
order: 1009
meta_title: Gallery of Video Labeling Templates
meta_description: Gallery of templates available to perform data labeling and annotation tasks with Label Studio for your machine learning model and data science projects.
layout: templates
Expand Down
263 changes: 0 additions & 263 deletions docs/source/templates/generative-chatbot-assessment.md

This file was deleted.

Loading

0 comments on commit 91ef076

Please sign in to comment.