A million-token context is useful only if serving it remains practical. Hy4 flash addresses that tension by combining a large, sparsely activated model with attention and decoding techniques designed to limit the cost of long-context inference. That makes it oriented toward everyday work rather than maximum capability on the hardest tasks.
Key Capabilities
- Long-context multimodal input: It accepts text and images and supports up to 1,048,576 tokens of context, enabling workflows that involve lengthy documents or visual material.
- Sparse computation: The model has about 220B total parameters but activates roughly 12B per token. Hybrid sparse attention and sliding-window attention, together with latent-space MoE experts, are intended to reduce inference overhead without shrinking the overall model.
- Cost-focused decoding: Its built-in DFly2 speculative-decoding drafter reuses the target model’s KV cache and sparse indices. Tencent reports decoding speeds above 150 tokens per second with its inference optimizations; that figure depends on serving setup.
Who It Suits
A good fit for document processing, search, slide work, visual understanding, and other productivity tasks where long context and lower serving cost matter. Look elsewhere for complex, long-horizon software engineering if the highest capability ceiling is the priority: Tencent recommends Hy4 for those workloads. Reported WorkIndex results and cost comparisons come from Tencent’s internal evaluations, so they are useful signals rather than independent guarantees.