From b3d6918ef161e30c26d16b191061fda9fd205850 Mon Sep 17 00:00:00 2001 From: NanoCode012 Date: Sat, 16 Sep 2023 01:14:15 +0900 Subject: [PATCH] Feat(doc): Add features to doc (#583) --- README.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/README.md b/README.md index fcb912d5b7..dc9953b76d 100644 --- a/README.md +++ b/README.md @@ -2,6 +2,18 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures. +Features: +- Train various Huggingface models such as llama, pythia, falcon, mpt +- Supports fullfinetune, lora, qlora, relora, and gptq +- Customize configurations using a simple yaml file or CLI overwrite +- Load different dataset formats, use custom formats, or bring your own tokenized datasets +- Integrated with xformer, flash attention, rope scaling, and multipacking +- Works with single GPU or multiple GPUs via FSDP or Deepspeed +- Easily run with Docker locally or on the cloud +- Log results and optionally checkpoints to wandb +- And more! + +