A Native-PyTorch Library for LLM Fine-tuning https://github.com/pytorch/torchtune
天问 087c92c1c1 Update 'README.md' | 8 months ago | |
---|---|---|
README.md | 8 months ago |
A Native-PyTorch Library for LLM Fine-tuning, officially supports Meta Llama3
pip install torchtune
tune download meta-llama/Llama-2-7b-hf \
--output-dir /tmp/Llama-2-7b-hf \
--hf-token <HF_TOKEN> \
tune run lora_finetune_single_device --config llama3/8B_lora_single_device