Engineering glossary
The real-time AI avatar glossary.
Build a shared language for conversation timing, speech audio, motion generation, client rendering, session reliability, and performance measurement.
Start here
Core concepts for a live avatar stack
Begin with the boundaries that connect listening, interruption, motion, and session state.
Voice Activity Detection
Voice activity detection classifies short audio frames as human speech or non-speech.
Read definitionTiming & turn-takingBarge-In
Barge-in allows a user to interrupt an avatar’s active response by speaking.
Read definitionMotion & lip syncSpeech-Driven Animation
Speech-driven animation generates timed facial or body movement from features in a spoken audio signal.
Read definitionSessions & reliabilityAvatar Session
An avatar session is a bounded runtime context containing configuration, authentication, connection, and conversational state.
Read definitionAll terms
Find the concept behind the behavior
Search by engineering term or narrow the directory to one layer of the avatar stack.
Showing all terms.
A
- Timing & turn-takingAcoustic Echo Cancellation
Acoustic echo cancellation removes the avatar’s speaker output from the microphone signal using a playback reference.
Open term - Audio & streamingAudio Backpressure
Audio backpressure is flow control applied when a producer generates audio faster than downstream components can consume it.
Open term - Audio & streamingAudio Chunking
Audio chunking divides a continuous speech stream into ordered blocks that can be processed incrementally.
Open term - Audio & streamingAudio Prebuffering
Audio prebuffering accumulates a minimum amount of media before playback or downstream processing begins.
Open term - Audio & streamingAudio Resampling
Audio resampling converts a signal from one sample rate to another while preserving its perceived timing and content.
Open term - Audio & streamingAudio Sample Rate
Sample rate is the number of audio samples captured or represented per second, measured in hertz.
Open term - Sessions & reliabilityAudio-Only Fallback
Audio-only fallback continues speech playback when avatar animation or rendering is unavailable.
Open term - Performance & playbackAudio-Video Synchronization
Audio-video synchronization aligns avatar motion with the corresponding moments in speech playback.
Open term - Rendering & runtimeAvatar Asset Bundle
An avatar asset bundle packages the meshes, textures, rig data, animations, and metadata needed to render an avatar.
Open term - Rendering & runtimeAvatar Asset Preloading
Avatar asset preloading fetches and prepares required resources before the avatar must first appear or speak.
Open term - Rendering & runtimeAvatar Frame Rate
Avatar frame rate is the number of visual frames actually presented per second.
Open term - Motion & lip syncAvatar Motion Frame
An avatar motion frame is a timestamped set of pose or facial-control values representing one instant of animation.
Open term - Rendering & runtimeAvatar Render Loop
An avatar render loop repeatedly updates animation state and submits the next visual frame for display.
Open term - Sessions & reliabilityAvatar Session
An avatar session is a bounded runtime context containing configuration, authentication, connection, and conversational state.
Open term - Audio & streamingAvatar Speech Audio
Avatar speech audio is the speech signal the avatar should perform, normally the output of a TTS system rather than the user’s microphone.
Open term
B
- Performance & playbackBandwidth Budget
A bandwidth budget is the planned sustained and peak network allowance for one avatar session.
Open term - Timing & turn-takingBarge-In
Barge-in allows a user to interrupt an avatar’s active response by speaking.
Open term - Performance & playbackBuffer Underrun
A buffer underrun occurs when playback consumes all ready media before the next required data arrives.
Open term
C
- Motion & lip syncCoarticulation
Coarticulation is the way neighboring speech sounds influence the mouth movement used to produce each sound.
Open term - Sessions & reliabilityConnection State
Connection state is an explicit representation of a runtime connection’s current lifecycle status.
Open term - Sessions & reliabilityConversation ID
A conversation ID is a stable identifier for one multi-turn interaction between a user and an avatar.
Open term - Timing & turn-takingConversational Overlap
Conversational overlap occurs when the user and avatar speak at the same time.
Open term
D
E
F
I
J
K
L
M
P
- Performance & playbackP95 Latency
P95 latency is the value at or below which 95 percent of measured latency observations fall.
Open term - Audio & streamingPCM16 Audio
PCM16 is uncompressed linear audio represented as signed 16-bit samples.
Open term - Motion & lip syncPhoneme-to-Viseme Mapping
Phoneme-to-viseme mapping converts linguistic speech-sound labels into visible mouth-shape categories.
Open term
R
S
- Timing & turn-takingSemantic Endpointing
Semantic endpointing uses linguistic context to predict whether a speaker’s thought is complete.
Open term - Sessions & reliabilitySession Token
A session token is a short-lived credential that authorizes an avatar client without exposing a permanent backend API key.
Open term - Rendering & runtimeShader Warmup
Shader warmup compiles and links graphics programs before their first visible use.
Open term - Motion & lip syncSpeech-Driven Animation
Speech-driven animation generates timed facial or body movement from features in a spoken audio signal.
Open term
T
- Timing & turn-takingTime to First Audio
Time to first audio is the interval from a defined request boundary to the first audible sample of the avatar’s response.
Open term - Performance & playbackTime to First Motion
Time to first motion is the interval from a declared speech-input boundary to the first usable or visible avatar motion.
Open term - Sessions & reliabilityToken Expiration
Token expiration is the time after which a session credential is no longer accepted.
Open term - Audio & streamingTTS Generation Speed
TTS generation speed is how quickly synthesized audio is produced relative to the duration of the resulting speech.
Open term - Timing & turn-takingTurn-Taking
Turn-taking is the control logic that decides whether the user or avatar currently holds the conversational floor.
Open term
V
W
- Rendering & runtimeWebAssembly Avatar Rendering
WebAssembly avatar rendering uses a compiled browser module for performance-sensitive runtime logic alongside a web graphics API.
Open term - Rendering & runtimeWebGL Context Loss
WebGL context loss occurs when the browser invalidates a page’s GPU rendering state and resources.
Open term
How to use this glossary
Start with the user-visible issue.
Open the closest term, define its event boundary and owner, then follow related concepts across the stack. Each page includes practical checks, failure modes, references, and implementation paths.
Reviewed 2026-08-19