A Native-PyTorch Library for LLM Fine-tuning https://github.com/pytorch/torchtune
天问
087c92c1c1
Update 'README.md'
|
2 weeks ago | |
|---|---|---|
| README.md | 2 weeks ago |
README.md
torchtune
A Native-PyTorch Library for LLM Fine-tuning, officially supports Meta Llama3
Usage
pip install torchtune
tune download meta-llama/Llama-2-7b-hf \
--output-dir /tmp/Llama-2-7b-hf \
--hf-token <HF_TOKEN> \
tune run lora_finetune_single_device --config llama3/8B_lora_single_device