torchtune

A Native-PyTorch Library for LLM Fine-tuning, officially supports Meta Llama3

Usage

pip install torchtune

tune download meta-llama/Llama-2-7b-hf \
--output-dir /tmp/Llama-2-7b-hf \
--hf-token <HF_TOKEN> \

tune run lora_finetune_single_device --config llama3/8B_lora_single_device