Quantifies active visual observation in multimodal LLMs with ActiveVision, a 17-task benchmark that forces repeated perception rather than one-shot description. Finds frontier MLLMs fail badly (top model 10.6% vs humans 96.1%) and that model-generated vision code does not close the gap.
Provides GGUF-format fine-tuned Qwen3.6-27B weights optimized for consumer hardware, offering NEO IMATRIX and MTP quant variants, vision support, 256k native context, and uncensored 'heretic' traces with published benchmark improvements over the base model.
Generates robot manipulation actions from visual observations and text instructions using a 1.5B vision-language-action model. Uses streaming context and visual-token compression to cut per-step compute, runs a unified policy across tasks, and is open-sourced on Hugging Face under Apache-2.0.
Predicts eight future [x,y,yaw] waypoints for language-conditioned embodied person-following using fused DINOv3 and SigLIP visual features; trained with quality-driven, DAgger-style self-evolving data and optimized for on-device inference (~5+ FPS, ~180 ms).
Predicts variable-cardinality sets of evidence intervals in videos to temporally ground queries using multimodal large language models. Combines caption-derived multi-span supervision, a temporal Wasserstein matching-free reward, and temporal IoU, yielding strong mIoU gains across multiple benchmarks.
GGUF-quantized releases (NEO IMATRIX + MTP) of a multi-stage fine-tuned, uncensored Qwen3.5-9B model with vision enabled and a native 256k context window—optimized for instruction following, reasoning and image-text-to-text workflows; released under Apache-2.0.
Adds vision to GLM-5.2 by attaching a MoonViT encoder and a trained 49.5M-parameter PatchMerger projector to enable image→text multimodal reasoning; text and vision backbones are frozen, uses NVFP4 quantized weights and targets Blackwell B200 GPUs.
Synthesizes RGB frames from structured world states exported by physics engines; it reformulates a heavy generative renderer into a few-step autoregressive streaming model and uses lightweight distilled codecs to reach playable ~30 FPS while preserving G-buffer and prompt control.
Analyzes internal computation of text-to-image diffusion transformers and shows structural template tokens act as implicit semantic registers that maintain object identity during denoising. Introduces a causal interpretability framework (attention decomposition + targeted interventions) and a training-free pruning rule that cuts ~20% attention FLOPs for a ~1.4-point GenEval drop.
Efficient 4B native-resolution diffusion foundation model for text-to-image generation and instruction-based image editing. Uses a lightweight Mage‑VAE tokenizer and a 4B NR‑MMDiT backbone to produce 512–2048 outputs with low memory and fast inference; ships in Base, RL-aligned and few-step Turbo variants.
Extrapolates long video sequences from very short contexts by restoring memory-writing supervision in autoregressive video diffusion models using a two-pass Self Gradient Forcing (SGF). SGF records a no-gradient rollout at a sampled denoising exit and then recomputes KV context in a second parallel pass so future losses teach earlier latent writes, enabling minutes-long extrapolation from ~5s windows.
Selects a referred target from candidate bounding boxes, then decodes tracking waypoints for single-camera embodied visual tracking. Injects past selected-bbox geometry via sliding-window TVBI tokens and is co-trained on a Refer‑QA dataset; achieves SOTA on EVT‑Bench and demonstrates sim-to-real on legged and humanoid robots.