This folder contains the following examples for Llama 2 models:
File | Description | Model Used | GPU Minimum Requirement |
---|---|---|---|
01_load_inference | Environment setup and suggested configurations when inferencing Llama 2 models on Databricks. | Llama-2-70b-chat-hf |
2xA100-80GB |
06_fine_tune_qlora | Fine-tune Llama 2 base models with QLORA. | Llama-2-70b-hf |
1xA100-80GB |
08_load_from_marketplace | Load Llama 2 models from Databricks Marketplace. | Llama-2-70b-chat-hf |
2xA100-80GB |