Directly maps visual observations and language instructions to continuous robot actions, replacing LLM-centric V→L→A pipelines. Uses separate visual and language encoders with lightweight bidirectional interaction and a compact decoder to cut inference cost and VRAM, achieving ~31 ms latency and <1 GB VRAM on an RTX 4090; suited for real-time robotic manipulation under tight compute budgets.
Evaluates whether vision-language models can make actionable decisions for a physical body by decoupling decision-making from low-level motor execution. Introduces HumanCLAW-Bench with 1,218 long-horizon egocentric episodes across 41 indoor scenes and diagnoses a lack of embodied self-awareness in current VLMs.
Learns a discrete “physical language” from unlabeled videos and uses a reason-then-render pipeline: predict compact state-transition tokens, then decode them into future video. Separates dynamics inference from pixel synthesis to improve physical fidelity, controllable simulation, and zero-shot motion transfer.
Estimates the visually attributable portion of a privileged teacher’s next-token corrections and reconstructs student-anchored training targets for multimodal on-policy distillation. Uses counterfactual teacher queries and a signed proxy to raise supported tokens and suppress refuted ones, improving fine-grained visual knowledge transfer across model scales.
Regularizes latent world models by replacing the Epps–Pulley Gaussianization objective with a quantile–quantile matching loss that aligns projected latent samples to rank-matched Gaussian quantiles, improving tail correction and planning success via cross-batch ranking.
AI Agent Papers2026
Evaluates vision-language model judges on computer-using agent (CUA) trajectories to measure verifier reliability. Provides OSReward-Hard and OSReward-Multi challenge sets, the OS-Shepherd-100K reasoning-annotated corpus, and trained OS-Shepherd reward models that match commercial judges at ~30–60× lower cost.
Provides a unified multimodal framework for large-scale 3D understanding, text-to-3D generation, and instruction-guided 3D editing. Trains on an 87M-sample 3D multimodal corpus (25M understanding, 50M generation, 12M editing) and pairs a vision-language model with a diffusion-based 3D synthesizer to preserve structure and enable part-aware edits; suited for researchers building text-driven 3D asset pipelines but requires large compute and data.
AI Model2026
Provides ComfyUI-ready INT8 MiniMax‑H3 checkpoints (conditioning encoder plus optional generation tail) for a Heretic-edited Qwen3‑VL‑32B source; preserves the vision tower in BF16 and uses row-wise ConvRot INT8 quantization to reduce VRAM needs for ~32GB GPUs. Not a full Transformers generation repository.
AI Video Papers2026
Introduces WorldExam, a diagnostic benchmark that evaluates controllable video world models across four levels from visual quality to inherent world reactivity. Covers 1,474 cases across eight tasks and supports camera-, action-, and language-driven paradigms, measuring scene-conditioned reactions beyond explicit instructions.
AI Model2026
ComfyUI-ready H3 conditioning encoder builds for Qwen3-VL-32B: a BF16 full-precision checkpoint, an INT8 ConvRot quantized checkpoint, and an optional generation tail (layers 50–63). Retains vision tower in BF16 and targets H3 workflows and lower-VRAM systems.
AI Dataset2026
Provides time-aligned simulated urban driving recordings that pair high-rate CSI/CIR with multi-view cameras, LiDAR, radar, IMU and GNSS for perception-to-channel research; contains 100 validated 1-second samples produced with CARLA and Sionna, but is limited in scene diversity and real-world fidelity.
AI Video Papers2026
Performs real-time, instruction-guided video-to-video editing on streaming input using a 16B autoregressive diffusion model that preserves subject identity and long-term temporal coherence; achieves end-to-end 720p at ≈30 FPS on a single Nvidia B200 GPU. Key features include chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD) that reduces diffusion to a two-step generator, and Long-Horizon Autoregressive Distillation to mitigate temporal drift.