AIAny
AI Model2026
Icon for item

Hy4

Handles text, image, and video understanding with sparse attention designed for contexts up to 1 million tokens. It has 770B total parameters with 49B activated per token, targeting long-document analysis, multimodal reasoning, and extended workflows.

Introduction

A million-token context window is useful only if a model can use it without attending densely to every token. This model pairs that scale with sparse selection: its indexer selects up to 2,048 context positions, while cross-layer index reuse and a speculative drafter are designed to keep long-context inference more manageable.

Key Capabilities
  • Long-context processing: The language backbone supports up to 1,048,576 tokens. Sparse attention focuses computation on selected positions, making the context limit more than a simple capacity figure.
  • Multimodal input: A vision encoder handles dynamic-resolution images and video frames, integrating their features with text for chart interpretation, visual reasoning, and computer-use workflows.
  • Sparse MoE architecture: The 770B-parameter backbone activates 49B text parameters per token, routing tokens through eight of 256 experts plus a shared expert. This separates total model capacity from per-token computation, though the overall model still requires substantial serving infrastructure.
  • Extended task execution: Training targets include software workflows, research tasks, finance, and office work, with reported strengths in long-horizon planning and tool use. These are model capabilities, not a guarantee of reliable autonomous execution.
Who It Suits—and the Trade-off

A good fit for teams evaluating open-weight models for long-context, multimodal, or tool-assisted workloads, especially when they can operate multi-GPU inference systems. Look elsewhere if you need a lightweight local model or consistently top-tier performance on research-level mathematics, long-horizon coding, or advanced visual question answering; the model card acknowledges remaining gaps against leading proprietary systems.

Information

  • Websitehuggingface.co
  • OrganizationsTencent Hy Team, Tencent
  • Published date2026/11/04

Categories

More Items

Hugging Face
AI Model2026

Runs text generation, summarization, and question answering directly on Windows devices as a 2.3B-parameter instruction-tuned model. It supports eight languages and a 32K context window, trading broad world knowledge and deep reasoning for local execution and privacy.

Hugging Face
AI Model2026

Estimates metric depth for every pixel in a photo, video, or live feed, with sharp object boundaries and stable results across frames. Multiple model sizes are available; weights are restricted to non-commercial research and academic development.

Hugging Face
AI Model2026

Provides quantized GGUF builds of Inkling 2 Mini for local text-and-image inference, with file sizes from about 7.76 to 22.87 GB. Runtime support for its looped transformer architecture may vary.