Llama-2-7b-chat-finetune-for-text2sql

Our Model is fine tuned on Llama-2 7B model on text-2-sql Dataset on alpaca format described by Stanford. The dataset 'ekshat/text-2-sql-with-context' is available on Huggingface . We have used QLora, Bits&Bytes, Accelerate and Transformers Library to implement PEFT concept. We have fine-tuned this model based on pre-trained Llama-2 7B model provided by 'NousResearch/Llama-2-7b-chat-hf'. For pretrained weights, Please visit : https://huggingface.co/ekshat/Llama-2-7b-chat-finetune-for-text2sql