Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Break document upload to chroma into batches #11

Merged
merged 5 commits into from
Nov 20, 2024
Merged

Conversation

matthewcoole
Copy link
Collaborator

Fix to resolve issue #10 by making use of chromadbs batch utility.

Copy link

github-actions bot commented Nov 8, 2024

answer_correctness: 0.5399824625735254
answer_relevancy: 0.5267372862254065
context_precision: 0.5190749703919484
context_recall: 0.4891578730333353

@matthewcoole
Copy link
Collaborator Author

Also had to fix error with importing the incorrect version of sqlite (see https://gist.github.com/defulmere/8b9695e415a44271061cc8e272f3c300)

Copy link

github-actions bot commented Nov 8, 2024

answer_correctness: 0.5133235667968713
context_precision: 0.4987762401718647
context_recall: 0.49376610381991903
answer_relevancy: 0.4793674287872676

@matthewcoole matthewcoole changed the title Breaks document upload to chroma into batches Break document upload to chroma into batches Nov 8, 2024
Copy link

answer_correctness: 0.49475684009606113
context_precision: 0.5143529955982925
context_recall: 0.4822786041643283
answer_relevancy: 0.49693642145497535

Copy link

answer_correctness: 0.49326721859297346
context_precision: 0.5516920085982062
context_recall: 0.501430485954934
answer_relevancy: 0.5076449428769897

Copy link

answer_relevancy: 0.49481817379875964
answer_correctness: 0.5208058934297858
context_precision: 0.5060375987845982
context_recall: 0.5385001632906659

@matthewcoole matthewcoole merged commit 7621920 into main Nov 20, 2024
1 check passed
@matthewcoole matthewcoole deleted the chroma_batch_error branch November 20, 2024 09:22
Copy link

answer_correctness: 0.4970787125085131
context_precision: 0.49257515028115967
answer_relevancy: 0.47996760434846025
context_recall: 0.5117758536662872

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant