Lets general-purpose vision-language models directly command robots via a compact mid-level action interface and asynchronous monitoring, enabling zero-shot manipulation without task-specific policy training; demonstrates strong sim benchmarks and real xArm6 transfer.
Provides official pretrained VisionHOPE visual-backbone checkpoints for ImageNet classification, COCO object detection & instance segmentation, and ADE20K semantic segmentation. Includes hierarchical Tiny/Small/Base models with PyTorch-compatible downloadable weights.
Turns solved protein structures into FoldingCorpus and Fold2Reason — a post-training recipe that supervises an LLM with discrete structural Q&A plus continuous 3D geometry to improve spatial, graph and scientific reasoning; reports consistent gains across 10 benchmarks.
Generates quantized point-and-box visual primitives for precise grounding across detection, referring, OCR, GUI and layout tasks; uses a shared coordinate vocabulary and staged pretraining to improve downstream robotic manipulation and autonomous driving when used as a visual backbone.
Processes text and images, with support for reasoning, coding, and tool use. Its trillion-parameter MoE activates about 49B parameters per token and supports a 1M-token context.
Provides calibrated probabilistic decisions (yes/no, 2–256 choice, 0–5 score) in one forward pass, with an optional adaptive-thinking mode that invokes Gemma‑4 when System 1 is uncertain; supports text+image, 256K context and vLLM serving, but adaptive thinking is much slower.
Generates 5-second text- or image-conditioned videos with synchronized 44 kHz audio (including lip-sync) and built-in super-resolution to 1920×1080; available in Lite (3B) and Pro (29B) variants with code and checkpoints released under an MIT license.
Provides a locally deployable, FP4-quantized variant of Qwen3.8-Flash-Next for multimodal (text, image, video) text generation. Uses NVIDIA Model Optimizer with quantization-aware distillation (QAD), a ~96 GiB checkpoint, and is validated on vLLM for Blackwell and DGX Spark.
Simulates how a scene changes in response to text-described actions, optionally conditioned on a starting image, and generates videos up to 20 seconds long. It pairs language-model reasoning about events with a 29B diffusion model for visual prediction.
Creates programmable, real-time interactive code-based environments by separating deterministic simulator state from a shared neural video renderer so agents perceive, interact, and iteratively evolve via distilled playbooks; introduces Adversarial Forcing to distill a geometry-conditioned renderer for responsive visual feedback.
Predicts identity-preserving dense pixel correspondences between image pairs that violate spatio-temporal priors (e.g., edits and reference-guided generation). Fuses generative (FLUX2) and semantic (DINOv3) foundation representations with heterogeneous supervision and teacher-guided iterative refinement to generalize beyond classical optical-flow assumptions.
Converts static 3D Gaussian Splatting scenes into endlessly looping 3D cinemagraphs by inferring plausible dynamics with a vision-language model, synthesizing a reference video, lifting it to multi-view videos, and fitting a Fourier-parameterized Periodic Deformation Field with a Grounded Drift Field—mask-free capture of deformation, object motion, and illumination changes.