Simulates a hospital LIMS to benchmark agentic clinical reasoning: agents inspect demographics, medications, lab orders/results and then submit ICD‑10 diagnostic reports scored by deterministic, context‑aware graders. Ships as an OpenEnv/FastAPI runtime with 8 scenarios, step‑level rewards and trajectory capture for RL, tool‑use and evaluation.
Evaluates agents inside a structured hospital workflow via a downloadable FastAPI runtime that enforces role-specific tool permissions, evidence-before-treatment discipline, deterministic grading, dense process rewards, and full trajectory logging. Designed for RL, offline policy learning, multi-agent workflow research and process-supervision datasets; not for real patient care.
Evaluates proactive, multimodal agents on 400 bilingual real‑world tasks across five capability axes (Skill Usage, Exploration, Long‑Context Reasoning, Multimodal Understanding, Cross‑Platform Coordination) using live Docker‑based, stepwise closed‑loop evaluation to separate base model skills from framework design.
Provides a deliberative Agent OS layer for robots that handles scene-conditioned planning, context-isolated skill execution, multi-stage verification, persistent multi-modal graph memory, and edge–cloud collaboration. Introduces EmbodiedWorldBench (16 scenes, 200+ tasks) and a failure-driven self-evolution loop; shows improved task success and strong memory benchmark scores.