|
|
@@ -1,3 +1,17 @@
|
|
|
# torchtune
|
|
|
|
|
|
-A Native-PyTorch Library for LLM Fine-tuning
|
|
|
+A Native-PyTorch Library for LLM Fine-tuning, officially supports **Meta Llama3**
|
|
|
+
|
|
|
+## Usage
|
|
|
+
|
|
|
+```
|
|
|
+pip install torchtune
|
|
|
+
|
|
|
+tune download meta-llama/Llama-2-7b-hf \
|
|
|
+--output-dir /tmp/Llama-2-7b-hf \
|
|
|
+--hf-token <HF_TOKEN> \
|
|
|
+
|
|
|
+tune run lora_finetune_single_device --config llama3/8B_lora_single_device
|
|
|
+
|
|
|
+```
|
|
|
+
|
