AIAny
AI Model2026
Icon for item

Hy3

Provides a large Mixture-of-Experts instruct LLM (295B total parameters, 21B active, 256K context) optimized for reasoning, long-context retention and agent workflows; open-sourced under Apache-2.0.

Introduction

Hy3 is notable because it pursues production reliability and long-horizon agent workflows at MoE scale rather than purely maximizing benchmark scores. The design and fine-tuning prioritize tool-calling stability, hallucination reduction, and multi-turn intent retention so the model behaves more predictably in real-world pipelines.

Key Capabilities
  • Sparse MoE architecture with 295B total parameters and ~21B active parameters, enabling higher parameter capacity while keeping per-token compute manageable; this translates into stronger reasoning and coding performance relative to many dense models of similar active size.
  • Very long context support (256K tokens) and improved multi-turn intent tracking, so it can handle large documents, extended agent chains, and long conversational state without rapid drift.
  • Production-focused post-training and RL scaling that reduced hallucination and formatting/tool-call failures; practical benefits include more reliable tool invocation and fewer invalid loops in agent setups.
  • Integration-friendly deployment recipes (vLLM, SGLang) and quantization/finetuning tooling aimed at lowering inference cost for real deployments.
Who It's For and Trade-offs

Great fit if you need an open-source instruct LLM for long-context document processing, multi-step agent orchestration, or productized coding assistants and can provision multi-GPU inference (or use supported inference stacks). Look elsewhere if you require minimal-resource local inference (Hy3 expects substantial TPU/GPU resources), strict small-model latency/footprint constraints, or if you prefer purely dense architectures for simpler deployment and compatibility in very small-scale environments.

Information

  • Websitehuggingface.co
  • OrganizationsTencent Hy Team, Tencent
  • Published date2026/07/02

Categories

More Items

Provides six open language models from 0.9B to 375B-A23B for reasoning and agentic tasks. The paper also introduces sparse attention and a decoding speedup that needs no separate draft model.

Hugging Face
AI Audio2026

Turns English text into speech with two American English voices, running on CPUs or in a browser. Its 4.5M-parameter model was trained from scratch on synthetic speech.

Hugging Face
AI Model2026

Simulates how a scene changes in response to text-described actions, optionally conditioned on a starting image, and generates videos up to 20 seconds long. It pairs language-model reasoning about events with a 29B diffusion model for visual prediction.