LLM Router — One API. Every Model.

llm-router — system boot

~/globians/llm-router$ boot --system

Architecture

Unified API Proxy

LLM Router aggregates 11 permanently free LLM providers into a single OpenAI-compatible endpoint with intelligent routing and automatic failover.

Your Application

Any SDK, framework, or language

OpenAI-Compatible API ProxyCore

Smart Auto, Custom Pool, Rate Limit Handling

11 Free LLM Providers

OpenAI · Claude · Gemini · DeepSeek · Llama · Mistral · Grok & 4 others

Smart Routing Engine

Automatically routes requests based on query complexity using NLP scoring. Supports Smart Auto routing (automatic selection), Custom Pools (user-defined groups), and intelligent rate limit handling with automatic key rotation and failover.

api.example.py

from openai import OpenAI

client = OpenAI(base_url="http://localhost:8000/v1")

response = client.chat.completions.create(

model="smart-auto",

messages=[...],

)

11

Free Providers

0$

API Costs

100%

Open Source

MIT

License

Capabilities

Powerful features

OpenAI Compatible

Use any existing OpenAI SDK.

Drop-in replacement for OpenAI API. Works with all existing code, libraries, and frameworks without any changes.

Smart Routing

Automatic request routing.

Smart Auto mode analyzes query complexity with NLP and automatically routes to the best provider. Or define custom pools.

Free Forever

Zero API costs. 11 providers.

Access permanently free LLMs. No sign-ups, no credit cards required. Just brilliant AI models at zero cost.

Resilient

Automatic failover and key rotation.

Built-in rate limit handling, automatic provider failover, and key rotation. Your app keeps running.

Live Playground

Try it right now

Route the same prompt across any model. Feel what it means to have one API for everything.

llm-router/playground

connected

Select Model

Prompt

Download

Download LLM Router

◆

v0.1.0

Version

◈

Windows

Platform

◉

MIT Open Source

License

◇

Tauri

Framework

DownloadWindows

→LLM.Router_0.1.0_x64-setup.exe

→LLM.Router_0.1.0_x64_en-US.msi

Download EXE Download MSI GitHub

Read Documentation

Builder

Built By

Jay
Rajankar

Software EngineerAI BuilderFounder @ Globians

LLM Router was created to simplify how developers manage and work with multiple AI providers through a single desktop experience.

GitHub Globians

LLM Router

Krolts

Ascend

BulkMail

AI Code Review

AI Legal Workflow

1def route(prompt, model="auto"):

2 context = retrieve_context(prompt)

3 optimal = select_model(context)

4 return generate(optimal, prompt)

Built In Public.

LLM Router is an open-source project developed by Jay Rajankar and available to the community through GitHub. Contribute, fork, and build on top of it.