Generates polygonal meshes from images using flow matching for fast, native mesh synthesis. Decodes vertices, edge connectivity, and face winding in one parallel pass, preserves artist-authored topology without vertex quantization or welding, supports a user-set vertex budget for face-count control, and completes image-to-mesh in ~6s median.
Directly maps visual observations and language instructions to continuous robot actions, replacing LLM-centric V→L→A pipelines. Uses separate visual and language encoders with lightweight bidirectional interaction and a compact decoder to cut inference cost and VRAM, achieving ~31 ms latency and <1 GB VRAM on an RTX 4090; suited for real-time robotic manipulation under tight compute budgets.
Autonomously proposes, modifies, executes, and evaluates ML experiments to study recursive self-improvement in machine learning engineering. Implements an open stack (OpenMLE-Gym, -RL, -Evo) and post-trains Frontis-MA1 (35B) around four evolution operators (Draft, Improve, Debug, Crossover); releases model weights and the full codebase.
Provides a unified multimodal framework for large-scale 3D understanding, text-to-3D generation, and instruction-guided 3D editing. Trains on an 87M-sample 3D multimodal corpus (25M understanding, 50M generation, 12M editing) and pairs a vision-language model with a diffusion-based 3D synthesizer to preserve structure and enable part-aware edits; suited for researchers building text-driven 3D asset pipelines but requires large compute and data.
A pretrain-then-transfer method for streaming recommendation that decouples refreshable behavioral knowledge from task-specific geometry to enable continual model refresh without downstream interference; introduces Behavioral Multi-Token Prediction and Anchored Calibration Residual and shows 4–12% offline gains plus live Shopee A/B lifts.
Frames skill generation as a sequential editing task and introduces a novel rollback reward to train an RL generator (Skill-α) that evaluates each edit by its downstream execution impact, producing skills that improve agent success rates across document-to-skill and experience-to-skill settings.
AI Video Papers2026
Performs real-time, instruction-guided video-to-video editing on streaming input using a 16B autoregressive diffusion model that preserves subject identity and long-term temporal coherence; achieves end-to-end 720p at ≈30 FPS on a single Nvidia B200 GPU. Key features include chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD) that reduces diffusion to a two-step generator, and Long-Horizon Autoregressive Distillation to mitigate temporal drift.
Replaces external environment interaction in agentic RL training with 'world rehearsal': the policy alternates between making tool calls and simulating their environment responses, jointly optimizing both roles so the agent internalizes environment dynamics and improves long-horizon tool use and transfer.
AI Video Papers2026
Uses video generation only as a training signal to co-train a pretrained video expert and a lightweight action expert, then discards the video branch at inference to produce a low-latency end-to-end driving planner; enhanced with RL for compositional driving rewards.
Tao Feng, Fangxu Yu +10University of Illinois Urbana-Champaign, University of Maryland, College Park +3
Frames LLM routing as a sequential decision process and introduces LLMRouter plus the xRouteBench benchmark to develop, evaluate, and deploy learned routing policies across heterogeneous LLMs, optimizing response quality versus inference cost.
Turns adapter placement for PEFT on YOLO-family real-time detectors into an auditable constraint-planning problem that emits budgeted target-module plans or calibrated refusals; shows planner-selected RS-LoRA improves mAP and cuts peak training memory in evaluated detectors.
AI Dataset2026
Provides a queryable dataset of 3,797,117 SKILL.md agent-skill files found on public GitHub, deduplicated by content hash and enriched with representative text, front matter, folder composition, repo metadata, and sampled commit history for research.