Accepts text, image and audio inputs and generates text outputs for conversational, instruction-following and multimodal tasks; a sparse-MoE autoregressive model (975B total, 41B active) with BF16/NVFP4 support and local-deploy recipes.
Generates synchronized audiovisual output from text, image, or audio prompts — a diffusion-based multimodal model with componentized weights (video/audio VAEs, multilingual text encoder, distilled transformer) and ready integration with HuggingFace pipelines and ComfyUI.
Multilingual, real-time ASR for edge CPUs that uses heterogeneous quantization to reduce model size (4.62→1.58 GB) and lower inference latency. Trades some accuracy for 1.6–2.3× faster inference vs. Whisper.cpp and real-time capability on a few CPU threads, making it suitable for memory- and compute-constrained on-device transcription.
Benchmark for joint speaker diarization and speaker-attributed ASR across all 22 scheduled Indian languages, providing ~108 hours of human-corrected, time-aligned, speaker-attributed transcripts. Includes near-field, far-field and in-the-wild recordings with code-mixing and speaker overlap.
Generates text from text, image, or audio inputs using a native multimodal, Mixture-of-Experts autoregressive transformer (276B total / 12B active) with up to 1M-token context; targeted at conversational, agentic, coding and multimodal applications.
Generates synchronized stereo audio and video from multimodal inputs (text, images, video, audio), producing 4–15s clips at 24 FPS with a 768p base and an in‑context regeneration path to 2K; supports first/last‑frame and multi‑reference modes and ships as two task‑specific checkpoints.
Multilingual neural text-to-speech model (0.6B params) with zero-shot voice cloning and a bundled 44.1 kHz codec. Preview release targets 11 recommended languages and aims to deliver near-SOTA quality in a compact checkpoint suited for voice cloning and multilingual TTS prototypes.
Captures synchronized multimodal embodied-human data in real homes — egocentric and multi-view video, metric body/hand/object motion, audio, and tactile signals. Released under a gated non-commercial research license with identifiable participants and strict non-redistribution/privacy constraints.
An end-to-end 11B full-duplex speech model for real-time conversational AI that jointly performs streaming speech understanding and generation, enabling ~450 ms turn-taking, barge‑in and live tool calling in a single unified architecture; research use only.
Retrieves short speech segments from MEG recordings with a compact interpretable neural decoder trained against wav2vec 2.0 embeddings, and maps decoder weights to cortical source space to reveal which acoustic and linguistic features drive retrieval.
Provides GGUF-quantized, ComfyUI-ready MiniMax‑H3 model files (FL2VA/REF2VA, text encoder, audio/video VAEs) to enable local ComfyUI inference for short video + stereo audio generation; requires the official VAEs and sufficient VRAM.
Installation-oriented dataset that packages ComfyUI-ready files and instructions for running MiniMax H3 locally — includes pruned/INT8/BF16 checkpoints, matching Qwen3-VL text encoders, video/audio VAEs, and official ComfyUI workflow templates for joint audio+video generation.