Orchestrates teams of sub-agents across text, image, audio and video by modality-aware task decomposition, online sub-agent specialization, and parallel execution; introduces DA-GRPO to train Orchestra-o1-8B and reports a ~10.3% accuracy improvement on the OmniGAIA benchmark.
Continuously watches live video and autonomously decides each second whether to speak, stay silent, or delegate; released together with an 8B vision-first model, time-aligned interaction data, training recipe, and a deployable real-time system. Designed for vision-triggered, low-latency streaming scenarios and evaluated across six real-world streams.
Adds interleaved text–image generation to existing image generators via a multi-agent pipeline: a planner sequences stepwise instructions, a critic detects and refines failures, and single-step RL (GRPO) reinforces per-step corrections—suited for visual narratives and embodied guidance.
Applies a population-level test-time scaling strategy that uses one model as generator, verifier, refiner, and ranker to search over candidate proofs. Combines generative-verifier RL and a low false-positive verifier with tournament selection to reach competition-level performance on IMO and USAMO.
Moves repository search into a dedicated exploration subagent that issues parallel read-only READ/GLOB/GREP calls and returns compact file:line citations. Trained (4B–30B) with SFT+RL, it reduces main-agent token use up to ~60% and raises end-to-end success by up to ~5.5%.
Provides a lightweight repository-exploration subagent for LLM coding agents: invoked on demand to run parallel read-only READ/GLOB/GREP calls and return compact file-path plus line-range citations so the main solver gets focused evidence instead of noisy reads.
Controllable long-horizon text/image-to-video generation that supports camera navigation, revisits, and promptable events across photorealistic and stylized domains. Introduces camera-aware positional encoding (E-PRoPE), memory-conditioned scene persistence, causal-forcing distillation, and RL alignment to retain camera control and reduce drift.
Provides a harness that lets language models control embodied manipulation via iterative perception–reasoning–action loops, semantic action abstractions, and multimodal observations. Demonstrates distilling capabilities into a 4B open-source model with under 2K simulated trajectories and shows sim-to-real generalization.
Proposes ZPPO, a distillation method that keeps the teacher inside prompts rather than injecting teacher gradients, using binary- and negative-candidate prompts plus a prompt replay buffer to recover learning signal on hard examples; shows gains for small Qwen3.5 students across 31 multimodal benchmarks.
Provides a dual-path approach for spatial vision-language models: a Language-Only Reasoning (LOR) path for stepwise linguistic deduction and a Detect-Then-Reason (DTR) path that detects 3D cues via region tokens before numerical inference. Trains with chain-of-thought cold-start supervision and reinforcement learning to improve 3D grounding and multi-step spatial reasoning.
Simulates agentic environments and predicts next environment states from actions and interaction history using a language-based world model across seven domains. Trained via a CPT→SFT→RL pipeline with an MoE architecture and very long context; intended for environment simulation and agent research.
Proposes Monotonic Inference Policy Improvement (MIPI) and a two-step Monotonic Inference Policy Update (MIPU) to address training–inference probability mismatch in LLM reinforcement learning by constructing sampler-referenced candidate updates and accepting synchronized updates using an inference-gap proxy; shows improved reasoning accuracy and stability under FP8-quantized rollouts.