Analyzes internal computation of text-to-image diffusion transformers and shows structural template tokens act as implicit semantic registers that maintain object identity during denoising. Introduces a causal interpretability framework (attention decomposition + targeted interventions) and a training-free pruning rule that cuts ~20% attention FLOPs for a ~1.4-point GenEval drop.
AI Model2026
Efficient 4B native-resolution diffusion foundation model for text-to-image generation and instruction-based image editing. Uses a lightweight Mage‑VAE tokenizer and a 4B NR‑MMDiT backbone to produce 512–2048 outputs with low memory and fast inference; ships in Base, RL-aligned and few-step Turbo variants.
AI Video Papers2026
Extrapolates long video sequences from very short contexts by restoring memory-writing supervision in autoregressive video diffusion models using a two-pass Self Gradient Forcing (SGF). SGF records a no-gradient rollout at a sampled denoising exit and then recomputes KV context in a second parallel pass so future losses teach earlier latent writes, enabling minutes-long extrapolation from ~5s windows.
Selects a referred target from candidate bounding boxes, then decodes tracking waypoints for single-camera embodied visual tracking. Injects past selected-bbox geometry via sliding-window TVBI tokens and is co-trained on a Refer‑QA dataset; achieves SOTA on EVT‑Bench and demonstrates sim-to-real on legged and humanoid robots.
Evaluates spatial cognition of image-generation models by eliciting protocol-constrained visual answers and parsing pixel outputs into structured predictions compatible with existing metrics. Introduces the ProVisE framework and SpatialGen-Bench (470 samples) to compare image-generation models and text-output VLMs on unified spatial tasks.
Converts image-content removal into a contrastive on-policy self-distillation signal: the EMA teacher produces next-token distributions with and without image content, uses their log-probability differences to sharpen visual-grounded candidates, and distills that full-distribution target into the student—no external teacher or extra inference cost.
AI Dataset2026
Evaluates atomic visual perception of multimodal LLMs using 3,000 short visual questions that isolate ten perceptual skills. Built from an error taxonomy across 42 benchmarks, capability-balanced and accompanied by a model leaderboard.
Empirically studies how transformer-based native multimodal pre-training scales under fixed compute, deriving compute- and data-allocation power laws and an efficiency frontier for model size, token count, and data mixture; evaluates cross-modal transfer and multimodal in-context learning.
AI Model2026
Delivers image and video understanding plus a built-in event‑gated streaming gate — a unified 4B multimodal foundation model that uses codec-aligned tokenization to cut visual tokens by >75% and yield up to 3.5× wall‑clock inference speedup for streaming and long‑horizon video tasks.
Enables tactile-aware robot manipulation by pretraining a vision–tactile–language–action foundation model and improving offline policies with ALTER. Combines large-scale NeoData visuo-tactile pretraining, a latent tactile pathway for predictive touch signals, and advantage‑conditioned offline RL for contact-rich tasks.
AI Dataset2026
Consolidated dataset of detection, visual grounding and pointing annotations with indexed WebDataset image shards and Megatron‑Energon training metadata. Covers diverse visual domains (COCO, RefCOCO, driving, GUI, documents) and uses a normalized spatial grid for cross‑domain vision–language grounding training.
AI Model2026
Generates text from text, image, or audio inputs using a native multimodal, Mixture-of-Experts autoregressive transformer (276B total / 12B active) with up to 1M-token context; targeted at conversational, agentic, coding and multimodal applications.