Uses diffusion-model forking moments as a proxy for perceptual distance to automatically generate pointwise reference-grounded labels, enabling annotation-free training of reference-based image quality assessment metrics.
Trains decoders and diffusion generators to be robust to random subsets of pretrained encoder layers by regularizing layer-fusion during training, narrowing the reconstruction–generation gap in representation autoencoders and improving ImageNet-256 PSNR and gFID.
Uses 360° panoramic observations to improve vision-and-language navigation by predicting longer action sequences, confidence-guided execution, and combined semantic–geometric panorama features; yields large SR gains on R2R-CE and RxR-CE Val-Unseen.
Multimodal real-robot dataset of 28,993 teleoperated bimanual manipulation demonstrations (~300 hours) with synchronized multi-view RGB/tactile videos, 65D robot state/action, 60D fingertip tactile signals, and temporally aligned language segments; intended for imitation, visuomotor and visual‑tactile research, CC BY‑NC 4.0 (non‑commercial).
Lets general-purpose vision-language models directly command robots via a compact mid-level action interface and asynchronous monitoring, enabling zero-shot manipulation without task-specific policy training; demonstrates strong sim benchmarks and real xArm6 transfer.
Groups visually grounded appearances of the same physical instance into persistent, retrievable “biographies” so agents can follow objects across hours or days for long-video question answering. Links identity-aware observations to episodic context and visual evidence; improves EgoLifeQA to 72.0% and increases evidence-window reach from 37.6% to 58.9%.
Provides official pretrained VisionHOPE visual-backbone checkpoints for ImageNet classification, COCO object detection & instance segmentation, and ADE20K semantic segmentation. Includes hierarchical Tiny/Small/Base models with PyTorch-compatible downloadable weights.
Predicts compact 'prospective tokens' that summarize upcoming information needs and uses them to select a small set of past frames for conditioning long-horizon video generation, improving long-range consistency, visual quality, and action alignment while remaining plug-and-play across diverse generators.
Delivers fast, calibrated 'System 1' decisions over text and images (yes/no, 2–256 choices, 0–5 scores) in one forward pass, plus full 'System 2' Qwen3.8-27B multimodal reasoning. Highlights: zero-shot vision judging, 256K-token context, vLLM decision API, Apache-2.0.
Parses documents and answers questions about their contents with a 0.8B-parameter model. It combines OCR, structured extraction, and visual question answering, including support for scanned, skewed, and photographed pages.
Turns a structured state (text/JSON/images/video) plus a schema of typed questions into probabilistic decisions in one forward pass. Multimodal, Jev/SystemOne-compatible, 64k context window, post-trained from Qwen3.8-27B; no free-form text output.
Generates quantized point-and-box visual primitives for precise grounding across detection, referring, OCR, GUI and layout tasks; uses a shared coordinate vocabulary and staged pretraining to improve downstream robotic manipulation and autonomous driving when used as a visual backbone.