ByteChor

Install dependencies

• Ollama - Install Ollama package for Mac/Linux

Compared to mistral and llama3, llama3 is very good at answering from the context

ollama pull nomic-embed-text
ollama pull mistral
ollama pull llama3
ollama list

• UV package manager python

brew install uv

• Poppler - PDF Reading

brew install poppler

• Install miniconda and create python3.12 environment

conda create --name py312 python=3.12
conda activate py312

• python modules

uv pip install -r requirements.txt

run project

python -m aichatbot --pdf_resource_path aichatbot.resources --model_name llama3 --input_question "who is president of India" --embedding_dir embeddings
python -m aichatbot --pdf_resource_path aichatbot.resources --model_name llama3 --input_question "what is consensus algorithm" --embedding_dir embeddings