Regularizes latent world models by replacing the Epps–Pulley Gaussianization objective with a quantile–quantile matching loss that aligns projected latent samples to rank-matched Gaussian quantiles, improving tail correction and planning success via cross-batch ranking.
Evolves persistent, stateful environments to red-team tool-using AI agents — provides 10K+ validated scenarios across 50 domains and a feedback-driven attack policy (EMHA) to surface long‑horizon safety failures.
Retrieves short speech segments from MEG recordings with a compact interpretable neural decoder trained against wav2vec 2.0 embeddings, and maps decoder weights to cortical source space to reveal which acoustic and linguistic features drive retrieval.
Provides a unified multimodal framework for large-scale 3D understanding, text-to-3D generation, and instruction-guided 3D editing. Trains on an 87M-sample 3D multimodal corpus (25M understanding, 50M generation, 12M editing) and pairs a vision-language model with a diffusion-based 3D synthesizer to preserve structure and enable part-aware edits; suited for researchers building text-driven 3D asset pipelines but requires large compute and data.
A pretrain-then-transfer method for streaming recommendation that decouples refreshable behavioral knowledge from task-specific geometry to enable continual model refresh without downstream interference; introduces Behavioral Multi-Token Prediction and Anchored Calibration Residual and shows 4–12% offline gains plus live Shopee A/B lifts.
Introduces WorldExam, a diagnostic benchmark that evaluates controllable video world models across four levels from visual quality to inherent world reactivity. Covers 1,474 cases across eight tasks and supports camera-, action-, and language-driven paradigms, measuring scene-conditioned reactions beyond explicit instructions.
A continuous-latent diffusion language model that preserves a high-capacity, decodable text latent and directly models its distribution via a block-causal diffusion transformer and query-based encoder–decoder; achieves top results on OpenWebText and XSum while scaling to 1B parameters.
Supervises audio reasoning by generating per-sample, audio-grounded rubrics that evolve with model rollouts and serve as reinforcement-learning rewards, improving perception and adaptive multi-step reasoning while avoiding reward saturation.
Generates multi‑speaker speech and environmental audio from textual instructions or a reference clip, supporting zero‑shot voice cloning and detailed scene/specification control. Combines a cleaned, captioned dataset with a VAE-based multimodal generator, reward-conditioned quality control, and staged training to improve expressiveness and multi-audio modeling.
Analyzes why supervised fine-tuning (SFT) causes severe task conflicts under multi-stage multi-task training while reinforcement learning (RL) enables stable coexistence, attributing the effect to sparse, near-orthogonal RL parameter updates and proposing Parallel-RL to decouple multi-task training.
Analyzes how to build effective training environment distributions for multimodal agents and proposes Ability-aware Environment Selection (AES) and Hierarchical Difficulty Curriculum (HDC) to improve diversity and difficulty scheduling, yielding large relative gains in experiments.
Detects and filters spurious token-level teacher supervision in on-policy distillation by estimating input-groundedness and removing high-impact misleading updates, improving OPD on both LLM and VLM benchmarks.