Provides a large-scale benchmark and a human-aligned metric for humanoid whole-body motion tracking — about 153 hours of optical mocap from professional performers plus HumanScore trained on 12K human-labeled preference pairs to reveal contact, timing, and stability failures.
Conducts end-to-end multidisciplinary research directly from heterogeneous raw evidence using lifecycle-wide perception and three autonomous agents (Ideation, Experiment, Writeup). Integrates perceptual analysis, execution provenance, and code-enforced checks to produce executable analyses, validated results, and compiled manuscripts across many modalities.
Performs unified parsing of digital and camera-captured documents (layout, text, tables, formulas) using a ~1.2B-parameter vision–language model. Key differences: geometry-aware modeling, curvature-guided sampling, and content-structure decoupled training to handle real-world deformations without separate dewarping.
Provides an L1 filtered English web corpus from recent Common Crawl snapshots for LLM pretraining, including main-text extraction, language and heuristic filtering, sensitive-field replacement, customized cleaning, and MinHash deduplication; contains 1T+ tokens across ~1.14B documents with structured metadata fields.
Provides a machine-readable catalog of 117 AI/AX safety and deployment-readiness diagnostic criteria for assessing model intrinsic and serving/infrastructure risks. Includes MODEL-SCAN and AX-SCAN axes, bilingual source fields, per-item evidence guidance, severity/assurance metadata, and a CC BY-NC 4.0 release-candidate.
Parses digital and camera-captured documents into structured outputs (text, layout, tables, formulas, figures) using a lightweight (~1.2B) open-source vision-language model. Uses geometry-aware modeling, multi-node consensus pseudo-labeling, and content-structure decoupling to handle warped, photographed, and digital pages.
Systematically evaluates AI-generated video detectors and generators for real-world crisis scenarios using RA-Bench (17,886 clips: 1,830 real anchors, 16,056 generated). Shows detector families fail to generalize across generation conditions, and that human-misleading videos and social dissemination further degrade detection.
Trains compact conversational agents to adapt at runtime to changing 'Harness' configurations (Skills, Hooks, prompts, tools) using Harness-Aware Training (HAT): Harness-State Augmentation, on-policy distillation, and RL to preserve generality while meeting low-latency deployment constraints.
Analyzes how on-policy distillation (OPD) transfers teacher LLM capabilities to student models across in-domain shifts, cross-domain transfer, and multi-teacher settings. Key findings: OPD conveys reasoning patterns rather than specific answers, same-origin teacher-student pairs generalize broadly, and multi-teacher combinations induce mixture-dependent tradeoffs.
Automates evaluation of visual world models via a hierarchical agent pipeline that decomposes each case, spawns specialized sub-agents to collect diagnostic evidence, and outputs a verifiable evidence tree plus a final verdict; validated on 18 models across 330 cases and released as a live evaluation pipeline.
Injects proprietary news, regulatory and legal data into an open checkpoint via data-centric continual learning to improve performance on legal, tax and journalism tasks while preserving general capabilities and very long context support.
Evaluates whether AI systems can independently carry out project-level scientific research by progressively removing human methodological guidance across 60 tasks in 11 domains. Built with expert review, sandbox execution, and multi-agent–model scoring to measure innovation and autonomous experimental execution.