Skip to main content

Using LiveKit Agents

LiveKit Agents is an open-source framework for building voice AI agents. The OpenRouter plugin allows you to access 400+ AI models from multiple providers through a unified API, with automatic fallback support and intelligent routing.

Installation

Install the OpenAI plugin to add OpenRouter support:
uv add "livekit-agents[openai]~=1.2"

Authentication

The OpenRouter plugin requires an OpenRouter API key. Set OPENROUTER_API_KEY in your .env file.

Basic Usage

Create an OpenRouter LLM using the with_openrouter method:
from livekit.plugins import openai

session = AgentSession(
    llm=openai.LLM.with_openrouter(model="anthropic/claude-sonnet-4.5"),
    # ... tts, stt, vad, turn_detection, etc.
)

Advanced Features

Fallback Models

Configure multiple fallback models to use if the primary model is unavailable:
from livekit.plugins import openai

llm = openai.LLM.with_openrouter(
    model="openai/gpt-4o",
    fallback_models=[
        "anthropic/claude-sonnet-4",
        "openai/gpt-5-mini",
    ],
)

Provider Routing

Control which providers are used for model inference:
from livekit.plugins import openai

llm = openai.LLM.with_openrouter(
    model="deepseek/deepseek-chat-v3.1",
    provider={
        "order": ["novita/fp8", "gmicloud/fp8", "google-vertex"],
        "allow_fallbacks": True,
        "sort": "latency",
    },
)

Web Search Plugin

Enable OpenRouter’s web search capabilities:
from livekit.plugins import openai

llm = openai.LLM.with_openrouter(
    model="google/gemini-3-flash-preview",
    plugins=[
        openai.OpenRouterWebPlugin(
            max_results=5,
            search_prompt="Search for relevant information",
        )
    ],
)

Analytics Integration

Include site and app information for OpenRouter analytics:
from livekit.plugins import openai

llm = openai.LLM.with_openrouter(
    model="openrouter/auto",
    site_url="https://myapp.com",
    app_name="My Voice Agent",
)

Resources