Translates incoming Chinese or English speech incrementally, aiming to keep lag low without losing meaning. This FP8 checkpoint returns translated text; speech synthesis and voice cloning require a separately configured TTS service.
Extracts a target speaker’s speech from mixed audio using that speaker’s mouth video, with causal streaming inference. It introduces a single-pass multi-scale separator and the RealSSA benchmark for dynamic, realistic acoustic scenes.