Trains LLM agents to proactively edit and manage their working context for long-horizon tasks using an expanded toolset (planning, long-term memory, soft offloading) and a fine-grained RL algorithm that identifies critical edits and assigns action-level credit. Improves accuracy while keeping contexts compact on long-context QA and deep search.
Generates compact keyword sets for both queries and items with LLMs and matches them directly via an inverted index. Uses supervised fine-tuning to align keyword spaces, then alternates GRPO-based reinforcement learning on query- and item-side generators to co-evolve representations and maximize retrieval F1 while staying compatible with keyword-based infrastructure.
Transforms source code into verifiable, reusable agent skills by extracting atomic operations, workflows, and recurring patterns and validating them via source-body-blind reconstruction. Produces CodeSkillBank (1,006,822 accepted records from 19,769 GitHub repos) and yields ~11.7% average downstream improvement.
Generates unified 768‑dimensional embeddings for text (including code), images, video and audio to enable cross‑modal semantic search and retrieval. Supports task instruction prefixes, Matryoshka truncation to 128/256/512/768 dims, and modular encoders for on‑device use under an Apache‑2.0 license.
Provides a self-evolving ontology layer that enables LLM-based data agents to query and interact with heterogeneous data via an MCP server; it auto-builds and iteratively refines schema, content, and tool layers based on agent interactions.
Scans long documents rendered as compressed page-images, locates relevant pages, and selectively expands only those pages to full text for question answering; built on Qwen3.5-9B, supports 5x/10x/15x compression and is released under Apple’s research-only model license.
Learns a camera-queryable implicit 3D-aware memory that compresses multi-view history into target-view tokens to enable long-horizon, camera-controllable video generation. Improves revisit consistency and camera-control accuracy and supports streaming exploration from a single image or text prompt.
Stores speaker-labeled verbatim messages alongside derived person- and group-level states to improve attribution and long-term memory in multi-party dialogues. Proposes a dual-track memory and a speaker-conditioned Writer trained with SpeakerLevenshtein and GRPO; yields consistent gains on multiple dialogue memory benchmarks.
Surveys memory mechanisms for autoregressive video generation, framing memory as persistent historical information that influences future generation. Organizes work by Forms, Functions, Operations, Learning, and Evaluation, and synthesizes challenges for long-horizon consistency and memory-aware learning.
Alternates a Planner (issues sub-queries) and a Synthesizer (integrates retrieved evidence into a persistent summary) to tackle long-horizon deep-search; introduces Role‑Decoupled Policy Optimization (RDPO) for role-specific RL credit assignment and shows strong results (IterSynth-8B reaches 50.7% on five benchmarks).
Reduces self-attention complexity to O(N log N) by using a coarse-to-fine (pyramid) Top-K block selection with LogSumExp scoring, implemented with hardware-aware Triton kernels for fused routing and scoring—aimed at long-context LMs and retrieval tasks.
Synthetic, clinician-verified ChatML dataset of 2,194 doctor–patient encounters covering 2,194 unique human diseases; each JSONL record includes 20 structured fields, verified PubMed references, realistic vitals/labs, and is intended for RAG and model fine-tuning (not medical advice).