Spatius + OpenAI Realtime API
The public Direct Mode Web quickstart sends browser microphone input to OpenAI Realtime, normalizes assistant PCM, and gives the generated speech to AvatarKit.
Read implementation guideIntegration library
Evidence-rated implementation guides that separate official paths, documented references, and unvalidated architecture blueprints. Only pages that pass the publishing gate become indexable.
First production batch
Three editorial reference pages with the deepest implementation detail and source annotations.
The public Direct Mode Web quickstart sends browser microphone input to OpenAI Realtime, normalizes assistant PCM, and gives the generated speech to AvatarKit.
Read implementation guideA React component or hook owns AvatarSDK initialization, avatar loading, AvatarView mounting, controller startup, and deterministic unmount cleanup.
Read implementation guideThe public Backend Mode server uses FastAPI WebSockets around an application-owned ASR, LLM, TTS stack and the Python Spatius Server SDK.
Read implementation guideEditorial roadmap
This page documents the LiveKit Agents boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Agora Conversational AI boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the TEN Framework boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the LiveKit Rooms boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Agora RTC boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Custom WebSocket boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the OpenAI Realtime API boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Gemini Live API boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Azure OpenAI Realtime boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Amazon Nova Sonic boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Ultravox Realtime boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the xAI Voice Agent API boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the OpenAI voice pipeline boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Deepgram, OpenAI, and Cartesia boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Deepgram STT boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Cartesia TTS boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Silero VAD boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the React boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Next.js boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Vue boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Vanilla JavaScript boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Vite boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the SwiftUI boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the UIKit boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Android with Kotlin boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Jetpack Compose boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Flutter boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the FastAPI boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Go Server SDK boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Node.js boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Python token server boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Go token server boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · documented pathThis page documents the Astro boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Nuxt boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Svelte boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the ElevenLabs TTS boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Deepgram Aura TTS boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Google Cloud Text-to-Speech boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Azure AI Speech boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Amazon Polly boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the PlayHT boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Pipecat boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the LangChain boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the LangGraph boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the LlamaIndex boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the OpenAI Agents SDK boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Google Agent Development Kit boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Sentry boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the PostHog boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprintThis page documents the Cloudflare Workers boundary, its own setup path, and a provider-specific failure condition rather than swapping a provider name into generic copy.
Published · architecture blueprint