How to use it. Is there some code examples?

[Mr-IT007]

How to use it. Is there some code examples?

[GanjinZero]

For training:

Training with RRHF
You can train your own model with generated or released datasets using the script train.sh, please note that the training process requires 8*A100 80GB GPUs, bf16 and FSDP. In the future, we will try efficient training methods such as LoRA or Prefix-tuning or Adapter to lower the computational resource requirements.

bash ./train.sh <path_to_alpaca_directory> <save_path_directory> <path_to_data_json>

For using Wombat:
Use recover_wombat_7b.sh and single_sentence_inference.py