Enables specifying exact 24-bit hex colors for object-level image generation and editing via a unified prompt interface, using a Paint-500K dataset and timestep-gated pure-color anchors to improve color fidelity.
Analyzes why on-policy distillation can produce excessively long student rollouts by identifying termination-token mismatch between students and teachers, and proposes aggregating functionally equivalent EOS tokens as a shared semantic stopping action to mitigate length inflation.
Provides a domain-agnostic world-modeling framework that factorizes latent targets into orthogonal predictive components, with dedicated prediction branches and synthesis for multi-domain forecasting and intervention. Demonstrates improved dynamics and long-horizon rollouts across seven domains and includes experimental biological validation.
Introduces a rubric-based approach for video reward modeling that generates explicit, query-adaptive evaluation criteria before scoring to reduce scalar drift; proposes RGPO, a two-stage training (seed warm-up + joint optimization) that achieves strong pointwise and pairwise evaluation with high data efficiency.
Uses a compact discrete-action interface (translation, rotation, gripper) to let frozen vision–language models control robots in closed-loop, and leverages in-context (one-shot) demonstrations to substantially improve manipulation success without robot-specific training.
Provides an open family of K–12 foundation models and a capability-oriented instruction-tuning corpus that teaches models to solve curriculum problems, map items to curriculum concepts, diagnose learner errors, and produce scaffolded pedagogical responses.
Provides a unified benchmark and a spatially aware omni-modal model for spatial audio-visual reasoning in embodied agents — OmniEchoBench (197 scenes, 2,972 QA pairs; 900 FOA-based navigation tasks) plus OmniEcho, which adds an FOA spatial encoder to a pretrained semantic audio pathway to enable spatial QA and sound-guided navigation.
An all-in-one multilingual scene text recognition approach that pairs a shared visual encoder with a script-aware Mixture-of-Experts (ScriptMoE) decoder to route each image to top-2 script experts. Introduces TextMuSS-10M, a synthetic dataset covering 10 scripts and 229 languages, and reports state-of-the-art accuracy and large end-to-end OCR F1 gains while remaining parameter-efficient.
Learns a camera-queryable implicit 3D-aware memory that compresses multi-view history into target-view tokens to enable long-horizon, camera-controllable video generation. Improves revisit consistency and camera-control accuracy and supports streaming exploration from a single image or text prompt.
Adds token-conditioned quantum residual branches to a frozen masked-diffusion language model: a lightweight hypernetwork emits continuous quantum-circuit coordinates per token, executes a shared sparse IQP-style circuit, and injects classically-expressible expectation readouts back into transformer blocks. Trains only the added branches, scaling to 16–64 qubits with analytic, linear-cost readouts.
Evaluates whether generative world models maintain consistent, controllable, and physically plausible simulated environments under exploration, interaction, and intervention. Introduces a six-level W1–W6 capability taxonomy across three tracks (video, spatial, embodied) with human A/B Arena and automated metrics to measure behavioral correctness.
Compresses a geometry-foundation model’s multi-level features into a compact latent that decodes jointly to RGB, depth, cameras and point maps — enabling a conditional flow to generate 3D-consistent video and novel views with measurably improved coherence.