llma2 模型管理工具,Llama 3, Mistral, Gemma, and other large language models https://github.com/jmorganca/ollama

天问 0a1cb7952d Add 'docker-compose.yml' 1 year ago
README.md 78953bbb21 Update 'README.md' 1 year ago
docker-compose.yml 0a1cb7952d Add 'docker-compose.yml' 1 year ago

README.md

Ollama

llma2 模型管理工具,在本地启动并运行大型语言模型。

Usage

wget https://github.com/jmorganca/ollama/releases/download/v0.1.11/ollama-linux-amd64
chmod +x ollama-linux-amd64


ollama run mistral

ollama run codellama

ollama run llama2
ollama run llama2-uncensored
ollama run llama2:13b
ollama run llama2:70b

ollama run orca-mini
ollama run vicuna


./ollama-linux-amd64  serve

Develop

安装基础依赖 git build-essential cmake go1.21

go build

或在容器中构建, Dockerfile.build