Listens and responds during live speech, interpreting cues such as hesitation, emphasis and sarcasm. Its replies can include expressive nonverbal sounds; Tag, Flash and E2E builds trade expressiveness, throughput and first-audio latency.
Clones voices from audio samples and generates steerable speech in 43 languages. Its sparse MoE activates about 100 million parameters per token, enabling real-time use in browsers and on local devices.
Continuously perceives live audio and video while deciding whether to respond, interrupt, or keep listening. It couples interaction reasoning with audiovisual generation for real-time, full-duplex exchanges.
Processes incoming and outgoing speech in parallel for real-time conversation, producing synchronized audio and text at 7.5 frames per second. Its continuous-audio design targets natural turn-taking rather than a conventional voice-assistant workflow.