Accelerates text-to-image diffusion for pretrained flow-matching models using a staged low-to-high-resolution pipeline: fast low-res sampling, pixel-space GAN super-resolution, light latent noising, and short high-res refinement — >10× end-to-end speedups without retraining.
Provides a portable C++ inference runtime to deploy embodied AI models (vision–language–action and world–action) on heterogeneous robot hardware, enabling latency-first batch-1 closed-loop control. Key features include modular multi-rate layers, fused low-latency inference, and extensible head/IO plugins.
Provides a systematic benchmark and design roadmap for video-based world models to evaluate robot policies, introducing WMBench and GigaWorld-1 optimized for long-horizon, action-faithful rollouts. Offers controlled comparisons across model families, action encodings, and 324k+ simulated vs real rollouts, with code, models, and datasets released for reproducible evaluation.
Compiles natural-language function specifications into compact, locally-executable neural programs (PAW) that run on a small frozen interpreter; a 4B compiler emits LoRA adapters for a 0.6B runtime to provide offline, low-memory fuzzy text functions.
Introduces a bounded-memory, typed-retrieval contract for long-horizon LLM agents and evaluates it in Slay the Spire 2 — assembling per-decision prompts from five typed slots rather than appending raw transcripts. Key outputs include ablationable memory layers, 298 labeled trajectories, and reproducible analysis scripts.
Detects when an action-chunked VLA policy drifts from expected visual dynamics and triggers lightweight corrective replanning via a latent-space vision monitor and online gradient guidance; creates an event-driven adaptive action horizon without retraining the backbone.
Generates temporally grounded captions for dense multi-event videos by restructuring autoregressive token dependencies to enable lossless parallel decoding; introduces a latent global planning module and event-factorized parallel decoding to improve grounding accuracy and achieve large decoding speedups.
Converts an academic paper into reusable extracted assets and then produces editable poster, synchronized talk video, and bilingual blog via modular generator skills. Key differentiator: a single Paper2Assets extractor shared by three editable generators plus an interactive Paper2Reel viewer that links slides, video, captions and blog while preserving factual consistency and round-tripable PPT/DOCX output.
Provides re-annotated academic video instruction data for captioning, video QA, and fine-grained motion understanding; rewrites short answers and concise captions into evidence-grounded, instruction-following responses and supplies JSONL annotation files (original videos not included).
Trains cross-platform GUI agents by combining a Uni-GUI cross-platform dataset with platform-conditioned multi-teacher on-policy distillation, enabling a shared policy to adapt to new platforms while retaining platform-specific behaviors; suitable for research on continual GUI agent learning and cross-platform adaptation.
Provides a reusable skill suite for evidence-grounded research ideation: Paper-Search for multi-source literature retrieval, Scoop-Check for prior-art collision checking, and IdeaSpark for pattern-guided idea generation, evidence auditing, and idea-card rendering.
Stabilizes on-policy policy distillation by dynamically constructing a proximal teacher that controls gradient variance. Provides theoretical global convergence and monotonic improvement bounds, and shows improved training stability, sample efficiency, and final performance on mathematical reasoning tasks with zero extra compute overhead.