LocalAI

LocalAI

已天迁移到 https://github.com/mudler/LocalAI

网站：https://localai.io/

go语言开发，基于开源本地模型 llama.cpp 后端，可以 docker 部署，有webui。

See examples on how to integrate LocalAI.

💻 Getting started

For a detailed step-by-step introduction, refer to the Getting Started guide.

For those in a hurry, here's a straightforward one-liner to launch a LocalAI AIO(All-in-one) Image using docker:

docker run -ti --rm --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu
# or, if you have an Nvidia GPU:
# docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-aio-gpu-nvidia-cuda-12

访问： http://127.0.0.1:8080/swagger

🚀 Features

• 📖 Text generation with GPTs (llama.cpp, gpt4all.cpp, ... :book: and more)
• 🗣 Text to Audio
• 🔈 Audio to Text (Audio transcription with whisper.cpp)
• 🎨 Image generation with stable diffusion
• 🔥 OpenAI functions 🆕
• 🧠 Embeddings generation for vector databases
• ✍️ Constrained grammars
• 🖼️ Download Models directly from Huggingface
• 🆕 Vision API

💻 Usage

Check out the Getting started section in our documentation.

🔗 Community and integrations

Build and deploy custom containers:

• https://github.com/sozercan/aikit

WebUIs:

• https://github.com/Jirubizu/localai-admin
• https://github.com/go-skynet/LocalAI-frontend

Model galleries

• https://github.com/go-skynet/model-gallery

Other:

• Helm chart https://github.com/go-skynet/helm-charts
• VSCode extension https://github.com/badgooooor/localai-vscode-plugin
• Local Smart assistant https://github.com/mudler/LocalAGI
• Home Assistant https://github.com/sammcj/homeassistant-localai / https://github.com/drndos/hass-openai-custom-conversation
• Discord bot https://github.com/mudler/LocalAGI/tree/main/examples/discord
• Slack bot https://github.com/mudler/LocalAGI/tree/main/examples/slack
• Telegram bot https://github.com/mudler/LocalAI/tree/master/examples/telegram-bot
• Examples: https://github.com/mudler/LocalAI/tree/master/examples/