diff --git a/README.md b/README.md index fcb912d5b7..dc9953b76d 100644 --- a/README.md +++ b/README.md @@ -2,6 +2,18 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures. +Features: +- Train various Huggingface models such as llama, pythia, falcon, mpt +- Supports fullfinetune, lora, qlora, relora, and gptq +- Customize configurations using a simple yaml file or CLI overwrite +- Load different dataset formats, use custom formats, or bring your own tokenized datasets +- Integrated with xformer, flash attention, rope scaling, and multipacking +- Works with single GPU or multiple GPUs via FSDP or Deepspeed +- Easily run with Docker locally or on the cloud +- Log results and optionally checkpoints to wandb +- And more! + +