Choose Direct Mode when the client can connect directly to Motion Server with a Session Token and send existing speech audio. Choose Backend Mode when your server must own the Motion Server connection, payload routing, transport, and centralized session control.
Compare the complete path.
Do not compare isolated numbers unless the definitions, inputs, environment, and included services match.
| Decision area | Direct Mode | Backend Mode |
|---|---|---|
| Motion Server connection | AvatarKit client | Customer backend Server SDK |
| Credential at runtime | Session Token on client | Backend credentials and server session |
| Downstream transport | Direct Motion Server path | LiveKit or customer-owned transport |
| Client role | Send audio, receive motion, render | Receive backend payloads and render |
| Server control | Token endpoint and application services | Session, routing, payload, and egress control |
| Implementation effort | Shorter path | More infrastructure and flexibility |
| Best fit | Existing client-side speech audio | Backend-owned production pipeline |
Two different operating models.
Architecture decides which team owns rendering, transport, recovery, and the surrounding AI product.
Direct Mode
AvatarKit connects from the client to Motion Server using a short-lived Session Token. The client renders locally, sends audio, receives motion data, and owns its lifecycle.
Backend Mode
A Server SDK connects from the customer backend to Motion Server. The backend forwards encoded audio and motion payloads to clients using LiveKit or a customer-owned transport.
Choose for the system you can operate.
The best option is the one whose responsibilities match your product, client, network, and team.
Choose Direct Mode when…
- Need the shortest standalone path
- Client already has speech audio
- Session Token endpoint is available
- No custom backend media transport is required
Choose Backend Mode when…
- Backend owns ASR/LLM/TTS pipeline
- Need central routing and observability
- Use LiveKit as downstream transport
- Custom payload transport is required
Limitations and unknowns
Direct Mode still requires a secure token endpoint; API keys must not be shipped to clients. Backend Mode adds operational responsibility and should not be chosen only because it sounds more enterprise-ready.
Build a controlled evaluation.
Use one workload and record both user experience and operational responsibility.
- Define the user job and acceptable fallback.
- Use the same input, session duration, and client.
- Record latency, traffic, compute, errors, and recovery.
- Compare total operating cost, not only list price.
Sources and freshness.
Last verified Aug 3, 2026. Recheck implementation details when SDKs or plan terms change.