Skip to content

Issues: JohnSnowLabs/langtest

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

74 Open 388 Closed
74 Open 388 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ModelAPI supports generating JSON schemas for its outputs.
#1167 opened Jan 16, 2025 by chakravarthik27
@chakravarthik27
Implement Med-Halt Tests for Robust Model Evaluation
#1166 opened Jan 16, 2025 by chakravarthik27
5 tasks
2.6.0
@chakravarthik27
Enhance the ModelAPI Class to Support JSON Schema Outputs ⭐ Feature Indicates new feature requests
#1165 opened Jan 16, 2025 by chakravarthik27
4 tasks
@chakravarthik27
Add new clinical benchmark datasets ⏭️ Next Release Issues or Request for the next release
#1163 opened Jan 13, 2025 by dcecchini
3
Fix vulnerabilities and security issues
#1159 opened Dec 30, 2024 by chakravarthik27
@chakravarthik27
Explore the ML Commons Benchmarks
#1154 opened Dec 17, 2024 by chakravarthik27
Data augmentation for de-biasing
#1151 opened Dec 11, 2024 by dcecchini
@chakravarthik27
1
Explore the DSPy and make integrations ⭐ Feature Indicates new feature requests
#1074 opened Jul 18, 2024 by chakravarthik27
Automatic Tests Info Registry with LangTest Versions ⭐ Feature Indicates new feature requests
#1072 opened Jul 18, 2024 by chakravarthik27
@chakravarthik27
Enhance Safety Tests and Develop Comprehensive Safety Test Dataset with Lamaguard 💡Enhancements Something can be improved
#1071 opened Jul 18, 2024 by chakravarthik27
@chakravarthik27
Interactive UI for LLM evaluation
#1069 opened Jul 16, 2024 by dcecchini
Explore Jailbreak resource (text + visual)
#1068 opened Jul 16, 2024 by dcecchini
2
Exploring LLM2LLM for Data Augmentation
#1002 opened Apr 1, 2024 by chakravarthik27
Rate Limit feature for Azure/OpenAI results generation 💡Enhancements Something can be improved
#988 opened Feb 27, 2024 by Jeff-ZYX
1
implementation of a leaderboard for different quantizations (gguf 4 vs 6 vs etc bits)
#987 opened Feb 26, 2024 by chakravarthik27
Enhancing Data Quality Testing for Langtest ⭐ Feature Indicates new feature requests
#982 opened Feb 19, 2024 by RakshitKhajuria
Explore litellm
#978 opened Feb 6, 2024 by ArshaanNazir
Do Embedding Benchamark for different datasets
#973 opened Feb 2, 2024 by ArshaanNazir
Explore AI-Secure ⏭️ Next Release Issues or Request for the next release
#971 opened Jan 31, 2024 by ArshaanNazir
Explore Together AI embedding models ⏭️ Next Release Issues or Request for the next release
#968 opened Jan 30, 2024 by dcecchini
Try different Prompting Techniques like few shot, ER , COT etc
#959 opened Jan 15, 2024 by ArshaanNazir
1
Explore Galileo's hallucination index ⏭️ Next Release Issues or Request for the next release
#957 opened Jan 11, 2024 by dcecchini
Add tests for De-Identification ⏭️ Next Release Issues or Request for the next release
#954 opened Jan 4, 2024 by dcecchini
@chakravarthik27 @ArshaanNazir
1
Add Word Embedding (with Pooling) to benchmark ⏭️ Next Release Issues or Request for the next release
#950 opened Jan 2, 2024 by dcecchini
Preparing Embeddings Benchmarks (LangTest)
#947 opened Dec 27, 2023 by ArshaanNazir
@chakravarthik27 @ArshaanNazir
9
ProTip! Updated in the last three days: updated:>2025-01-14.