A Native-PyTorch Library for LLM Fine-tuning https://github.com/pytorch/torchtune

天问 087c92c1c1 Update 'README.md' 8 months ago
README.md 087c92c1c1 Update 'README.md' 8 months ago

README.md

torchtune

A Native-PyTorch Library for LLM Fine-tuning, officially supports Meta Llama3

Usage

pip install torchtune

tune download meta-llama/Llama-2-7b-hf \
--output-dir /tmp/Llama-2-7b-hf \
--hf-token <HF_TOKEN> \

tune run lora_finetune_single_device --config llama3/8B_lora_single_device