LocalAI
1-Click installation template for LocalAI on Easypanel
Description
LocalAI is a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-premises with consumer grade hardware, supporting multiple model families and not requiring GPU.
Benefits
- OpenAI API Compatible: Drop-in replacement for OpenAI API that works with existing applications.
- Local Inference: Run AI models locally without sending data to external services.
- Multiple Model Support: Supports various model families including LLMs, image generation, and audio.
Features
- Local LLM Hosting: Host and run large language models locally on your hardware.
- API Compatibility: Full compatibility with OpenAI API specifications for easy integration.
- Multi-Modal Support: Support for text generation, image creation, audio processing, and more.
- GPU Acceleration: Optional GPU support for faster inference with NVIDIA CUDA.
Links
Options
| Name | Description | Required | Default Value |
|---|---|---|---|
| App Service Name | - | yes | localai |
| App Service Image | - | yes | localai/localai:v2.29.0-aio-cpu |
| Debug Mode | - | yes | false |
Screenshots
Change Log
- 2025-06-10 – Template Release