Jointly decides when waiting agent sessions should run on GPUs and which node should serve them. Scheduling accounts for tool-return readiness, time-decaying node cache value, and token demand.
Streams long videos using chunk-wise causal attention and a multi-GPU pipeline. Its five-step model improves motion while maintaining visual quality; on eight H200 GPUs, end-to-end throughput reaches 134.8 FPS.