How to Self-Host LibreChat

How to Self-Host LibreChat

LibreChat is a feature-rich chat interface that supports multiple AI backends. Self-hosting it on your Breeze gives you a private, customizable AI chat platform.

Requirements

• A Breeze with at least 4 GB RAM
• Docker and Docker Compose installed
• Git

Installation

git clone https://github.com/danny-avila/LibreChat.git
cd LibreChat
cp .env.example .env

Configure the Environment

Edit the .env file to set your preferences:

nano .env

Key settings to configure:

• DOMAIN_SERVER -- your Breeze IP or domain
• ALLOW_REGISTRATION -- set to false for private use
• Add API endpoints for Ollama or LocalAI running on your Breeze

Launch with Docker Compose

docker compose up -d

Access LibreChat at http://your-breeze-ip:3080.

Connect to Local Models

In the librechat.yaml config file, add your Ollama endpoint:

endpoints:
  custom:
    - name: "Local Ollama"
      apiKey: "dummy"
      baseURL: "http://host.docker.internal:11434/v1"
      models:
        default: ["llama3", "mistral"]

Updates

Pull the latest version with:

git pull
docker compose down && docker compose up -d