llma2 模型管理工具,Llama 3, Mistral, Gemma, and other large language models https://github.com/jmorganca/ollama

天问 03041210aa Update 'README.md' 2 months ago
README.md 03041210aa Update 'README.md' 2 months ago
docker-compose.yml 0a1cb7952d Add 'docker-compose.yml' 2 months ago

README.md

Ollama

llma2 模型管理工具,在本地启动并运行大型语言模型。

Usage

https://github.com/jmorganca/ollama 地址已迁移到 https://github.com/ollama/ollama

# 安装 ollama
wget https://github.com/jmorganca/ollama/releases/download/v0.1.11/ollama-linux-amd64
chmod +x ollama-linux-amd64
# 或者
curl -fsSL https://ollama.com/install.sh | sh


ollama pull llava   # 
ollama push llava   # 发布一个镜像

ollama list
ollama cp
ollama show
ollama create # 通过 Modelfile 创建模型
ollama rm


ollama run mistral

ollama run codellama

ollama run llama2
ollama run llama2-uncensored
ollama run llama2:13b
ollama run llama2:70b

ollama run orca-mini
ollama run vicuna


./ollama-linux-amd64  serve     # 或 ollama serve


Develop

安装基础依赖 git build-essential cmake go1.21

go build

或在容器中构建, Dockerfile.build