Skip to content

Latest commit

 

History

History
 
 

llamav2-70b

alt text

Example notebooks for the Llama 2 70B model on Databricks

This folder contains the following examples for Llama 2 models:

File Description Model Used GPU Minimum Requirement
01_load_inference Environment setup and suggested configurations when inferencing Llama 2 models on Databricks. Llama-2-70b-chat-hf 2xA100-80GB
06_fine_tune_qlora Fine-tune Llama 2 base models with QLORA. Llama-2-70b-hf 1xA100-80GB
08_load_from_marketplace Load Llama 2 models from Databricks Marketplace. Llama-2-70b-chat-hf 2xA100-80GB