Analyzes adversarial weaknesses of World-Action Models (WAMs) via BadWAM, a framework that crafts visual perturbations to decouple a model’s imagined future from its executed actions. Introduces two attack modes—action-only (disruptive) and imagination-preserving (stealthy)—and shows large drops in closed-loop task success (e.g., 96.5%→43.1%).
Policy-adaptive multimodal safety classifier that evaluates text and images against free-form natural-language policies and returns a continuous yes/no safety score. Produces a single-token verdict from a 3B-parameter model, supports multiple languages, and is designed for lightweight real-time moderation.
A vision-language-action foundation model trained on 100k+ hours of real-world robot manipulation trajectories to follow natural-language instructions and adapt to downstream tasks with minimal fine-tuning. Uses a two-stage (pre-/post-) training recipe and a scalable auto-labeling pipeline; shows clear scaling benefits and state-of-the-art sim-to-real transfer on standard benchmarks.
Evaluates whether video models reason according to physical laws by treating generated videos as visible reasoning traces and using a three-stage Perception–Formulation–Deduction protocol. Includes Orchard (400 mechanics videos), chain-of-frames prompting on annotated first frames, and a hybrid MLLM-plus-objective scoring suite for stage-resolved diagnostics.
Quantifies active visual observation in multimodal LLMs with ActiveVision, a 17-task benchmark that forces repeated perception rather than one-shot description. Finds frontier MLLMs fail badly (top model 10.6% vs humans 96.1%) and that model-generated vision code does not close the gap.
Provides GGUF-format fine-tuned Qwen3.6-27B weights optimized for consumer hardware, offering NEO IMATRIX and MTP quant variants, vision support, 256k native context, and uncensored 'heretic' traces with published benchmark improvements over the base model.
Generates robot manipulation actions from visual observations and text instructions using a 1.5B vision-language-action model. Uses streaming context and visual-token compression to cut per-step compute, runs a unified policy across tasks, and is open-sourced on Hugging Face under Apache-2.0.
Predicts eight future [x,y,yaw] waypoints for language-conditioned embodied person-following using fused DINOv3 and SigLIP visual features; trained with quality-driven, DAgger-style self-evolving data and optimized for on-device inference (~5+ FPS, ~180 ms).
Predicts variable-cardinality sets of evidence intervals in videos to temporally ground queries using multimodal large language models. Combines caption-derived multi-span supervision, a temporal Wasserstein matching-free reward, and temporal IoU, yielding strong mIoU gains across multiple benchmarks.
GGUF-quantized releases (NEO IMATRIX + MTP) of a multi-stage fine-tuned, uncensored Qwen3.5-9B model with vision enabled and a native 256k context window—optimized for instruction following, reasoning and image-text-to-text workflows; released under Apache-2.0.
Adds vision to GLM-5.2 by attaching a MoonViT encoder and a trained 49.5M-parameter PatchMerger projector to enable image→text multimodal reasoning; text and vision backbones are frozen, uses NVFP4 quantized weights and targets Blackwell B200 GPUs.
Synthesizes RGB frames from structured world states exported by physics engines; it reformulates a heavy generative renderer into a few-step autoregressive streaming model and uses lightweight distilled codecs to reach playable ~30 FPS while preserving G-buffer and prompt control.