Supervises audio reasoning by generating per-sample, audio-grounded rubrics that evolve with model rollouts and serve as reinforcement-learning rewards, improving perception and adaptive multi-step reasoning while avoiding reward saturation.
Generates multi‑speaker speech and environmental audio from textual instructions or a reference clip, supporting zero‑shot voice cloning and detailed scene/specification control. Combines a cleaned, captioned dataset with a VAE-based multimodal generator, reward-conditioned quality control, and staged training to improve expressiveness and multi-audio modeling.
Generates short videos with stereo audio from text prompts using a MiniMax‑H3 checkpoint; community‑uploaded on Hugging Face and distributed under Apache‑2.0. Tuned toward stylized creature and floral visuals and updated frequently per the model card.
A LoRA adapter for MiniMax-H3 that enables joint video + synchronized stereo audio generation in as few as 4 sampler steps, cutting sampling time roughly ~5×; early prototype under-trained, so 6–8 steps or newer checkpoints give better sharpness.
Provides ComfyUI-compatible pruned/curve-form LoRA conversions of the MiniMax‑H3 Turbo 4-step audio‑video generation preview, including further-trained ckpt500 EMA and non‑EMA variants and an example ComfyUI workflow for low-step experiments.
Packaged diffusers checkpoint of MiniMax H3 for image/text-to-short-video generation with native stereo audio; provided for direct use in diffusers image-to-video pipelines and aimed at easy integration into prototyping and production workflows.
Provides ComfyUI-compatible conversions and LoRA adapters of the MiniMax‑H3 video+audio generative model, with example presets and demo videos to run short stereo audio+video inference inside ComfyUI workflows.
Generates complete songs (up to five minutes) from lyrics and a music description, producing 32 kHz stereo WAV with expressive vocals and long-range musical structure. Uses hierarchical LLMs fused with flow-matching/Flow-VAE synthesis for coherent arrangement and timbre; requires CUDA and integrates with Diffusers and SGLang-Omni.
100-hour, single-narrator Egyptian Arabic speech corpus with 15,653 aligned clips at 24 kHz for TTS and ASR fine-tuning; studio-consistent audio, machine-generated undiacritized transcripts, CC BY-NC 4.0 (research/non-commercial use).
Multimodal Mixture-of-Experts text-generation model that accepts text, images, video and audio and returns text; preview open-weight release with 280B total params, 16B activated params, up to 512K token context and BF16/FP8 checkpoints under Apache-2.0.
Generates and edits speech from natural-language instructions plus optional reference audio, supporting zero-shot TTS, content/acoustic/paralinguistic edits, enhancement, and source separation. Open-source 1.5B-parameter base model with a 4-step distilled AuK‑Flash for faster inference.
Zero-shot multilingual text-to-speech checkpoint for speech generation and voice cloning with a compact footprint. Features an ~170M-parameter main model plus a bundled ~120M-parameter codec decoder, with primary support for Chinese and English; other languages show more variable quality and long/noisy references reduce fidelity.