llma2 模型管理工具,在本地启动并运行大型语言模型。
https://github.com/jmorganca/ollama 地址已迁移到 https://github.com/ollama/ollama
# 安装 ollama
wget https://github.com/jmorganca/ollama/releases/download/v0.1.11/ollama-linux-amd64
chmod +x ollama-linux-amd64
# 或者
curl -fsSL https://ollama.com/install.sh | sh
ollama pull llava #
ollama push llava # 发布一个镜像
ollama list
ollama cp
ollama show
ollama create # 通过 Modelfile 创建模型
ollama rm
ollama run mistral
ollama run codellama
ollama run llama2
ollama run llama2-uncensored
ollama run llama2:13b
ollama run llama2:70b
ollama run orca-mini
ollama run vicuna
./ollama-linux-amd64 serve # 或 ollama serve
安装基础依赖 git build-essential cmake go1.21
go build
或在容器中构建, Dockerfile.build