Synthesizes high-quality targets for real-world image restoration by using multimodal foundation models (MFMs) to convert real low-quality photos into HQ references. Provides GGT-100K (103,707 LQ–HQ training pairs + 500 test pairs) with multi-stage quality control and demonstrates consistent generalization gains for a range of restoration models, especially for finetuning generative restorers.
AI Model2026
A GGUF-quantized, locally runnable build of Gemma 4 12B Unified (image-text-to-text) packaged by unsloth; preserves multimodal (image/audio) input support under an Apache-2.0 license and is compatible with common GGUF runtimes and Unsloth Studio.
Generates synchronized, streaming spatial audio from panoramic video and text prompts using a causal autoregressive diffusion transformer. Combines Spatial Video-Audio Contrastive (SVAC) alignment and online direct preference optimization (ODPO) to improve spatial perception, plus an automated annotation pipeline and public demos.
AI Dataset2026
Evaluates metric 3D spatial reasoning from single driving images via multiple-choice questions that require reconstructing scene geometry rather than relying on image-layout shortcuts. Each sample pairs a numbered-bbox image with a question, four choices, and the correct answer; images come from PlusAI and the dataset is CC BY 4.0.
AI Model2026
Generates and reasons about multimodal physical-world content—text, images, video, audio, and robot/action trajectories—conditioned on combinations of text, image, video and action inputs. The 64B “Super” variant targets Physical AI use cases and supports vLLM‑Omni, Diffusers, and action prediction.
Omnimodal world model that jointly processes and generates text, images, video, audio, and action trajectories for physical AI. Uses a mixture-of-transformers to combine autoregressive reasoning and diffusion-based multimodal generation; released open-source with checkpoints, datasets and benchmarks for robotics and simulation.
AI Agent Papers2026
Workflow-aware benchmark for autonomous medical-AI research that splits agent execution into five stages (Plan, Setup, Validate, Inference, Submit) and evaluates long-horizon runs across segmentation, image enhancement, VQA, report generation, and lesion detection with stage-level scoring.
Evaluates multimodal LLMs on streaming egocentric video for spatial intelligence using 1,680 human-annotated questions across 348 videos; organizes tasks into four hierarchical levels (perception → tracking → simulation → allocentric mapping) and highlights allocentric mapping as the main bottleneck.
Studies when and how to combine visual future rollouts from world models with abstract reasoning in multimodal LLMs. Proposes PF-OPSD — a teacher-student distillation that uses ground-truth future videos during training — and evaluates on two human-verified benchmarks, improving accuracy ≈10% while improving robustness to noisy rollouts.
AI Video2026
Generates minute-level, multi-shot synchronized audio+video from a single text prompt, using a paired cross-modal memory to preserve character appearance and voice across shots. Uses DMD-distilled few-step inference for ~7.5× speedup; requires high-GPU memory and is released under the LTX-2 community license.
Explores how training recipe — data composition, teacher guidance, and task mixture — shapes few-step distillation for text-to-image generation and instruction-guided image editing; introduces Qwen-Image-Flash and empirical findings that training pipeline organization matters as much as distillation objectives.
AI Model2026
Native multimodal model for image/text/video→text tasks with million‑token context support. Uses a sparse-attention operator to cut long‑context compute and latency, and targets agentic, coding, and long-horizon conversational workloads.