AIAny
AI Model2026
Icon for item

Haru-4B

Processes incoming and outgoing speech in parallel for real-time conversation, producing synchronized audio and text at 7.5 frames per second. Its continuous-audio design targets natural turn-taking rather than a conventional voice-assistant workflow.

Introduction

Most speech systems make one side wait: they listen, finish processing, then respond. This model instead treats listening and speaking as simultaneous streams, aiming to capture the interruptions, backchannels, and overlapping turns that make conversation feel natural. That makes it a research platform for real-time spoken interaction, not a drop-in factual assistant.

Key Capabilities
  • At 7.5 frames per second, each 133 ms step consumes user audio while predicting the model’s next audio and text. A shared timeline avoids serializing the conversation into listen-then-speak turns.
  • Audio is represented as a 64-dimensional continuous latent per frame and generated in one MeanFlow sampling step. This avoids discrete audio tokens and a separate audio-generation transformer, reducing sequential generation work.
  • A character prompt and reference clip control persona and voice. Training covers over 160 languages, with primary focus on English, Spanish, Portuguese, German, French, Chinese, Japanese, Russian, and Korean.
Who It Suits

A good fit for researchers exploring low-latency speech-to-speech interaction, turn-taking, and voice-conditioned dialogue. Look elsewhere if you need a dependable instruction-following or fact-answering assistant: this is a pretrained base model, and its voice imitation should only be used with voices you have permission to use. Real-time use also benefits from capable local hardware and wired audio devices.

Information

  • Websitehuggingface.co
  • OrganizationsHigurashi AI
  • AuthorsRikuto Kotoge
  • Published date2026/11/12

Categories

More Items

Hugging Face
AI Model2025

Labels who speaks when in an audio recording, with improved speaker assignment and counting. It runs locally, supports offline use, and offers an exclusive diarization output that is easier to align with transcription timestamps.

Hugging Face
AI Model2026

An experimental Qwen3.8-27B variant edited in weight space to use fewer reasoning tokens; reported evaluations show higher accuracy on GPQA Diamond and LiveCodeBench v6.

Hugging Face
AI Model2026

Listens and responds during live speech, interpreting cues such as hesitation, emphasis and sarcasm. Its replies can include expressive nonverbal sounds; Tag, Flash and E2E builds trade expressiveness, throughput and first-audio latency.