Run low-latency voice and text conversations on your own stack
LocalAI’s Realtime API lets you build voice and text experiences over WebSocket or WebRTC using an OpenAI-compatible protocol. It is aimed at developers who want a self-hosted, configurable realtime layer with their own VAD, STT, LLM, and TTS components.
Agenticness = how independently a tool can take action, scored across 9 dimensions. Scored independently by David Kooi, Skylark Creations — see full rubric →
Is this your tool? Claim this listing to manage your content and analytics.
What's happened with LocalAI lately
- Score changeRubric upgrade v3_0 → v3.1: score 4/32 → 12/364 → 12/36(+8)
Rubric upgrade: agenticness v3.0 (8 dims, /32) → v3.1 (9 dims, /36). Adds Dim 9 (Operator Sovereignty), splits Dim 6 into 6a/6b lenses, tightens Dim 4 autonomous-retry distinction. Not a product change — score shift reflects new dimension + recalibrated rubric, not a change in the tool. Fanout suppressed.
See the news that prompted this
News mentions sourced from our news feed; score changes from periodic re-evaluations.
Ask about LocalAI
Get answers based on LocalAI's actual documentation
Try asking:
About
LocalAI Realtime API is a self-hosted, OpenAI-compatible realtime interface for low-latency voice and text conversations. It is built for developers who want to serve multimodal chat locally or on their own infrastructure rather than relying on a hosted API.
This is infrastructure, not a turnkey assistant. The realtime experience depends on the models and backends you install and configure, so quality and latency will vary based on your stack. WebRTC also requires the Opus backend to be installed separately.
Executes tasks you assign, one step at a time, within narrow domains.
Dimension Breakdown
Categories
Ask about LocalAI
Try asking:
- Free / open source — full functionality available at no cost.
Related Tools
Get the weekly agentic AI briefing
New tools, top picks, and trends — delivered every Thursday.