Skip to content

Latest commit

 

History

History
11 lines (9 loc) · 828 Bytes

README.md

File metadata and controls

11 lines (9 loc) · 828 Bytes
Raw

chat-with-your-docs

Chat with your Text Documents (upto 100MB in size)

Tech Stack Used:

  • LlamaIndex for parsing documents
  • ChromaDB for vector database storage, ranking and retrieval
  • Choice of OpenAI/HuggingFace as the LLM (Large Language Model) for both embedding and inference. Obtain an API key from here for OpenAI or here for HuggingFace
    • Embedding models are sentence-transformers/all-MiniLM-L6-v2 for HF and text-embedding-3-small for OpenAI
    • Inference models are meta-llama/Meta-Llama-3.1-8B-Instruct for HF and gpt-4o-mini for OpenAI

Try out the App here