Jointly decides when waiting agent sessions should run on GPUs and which node should serve them. Scheduling accounts for tool-return readiness, time-decaying node cache value, and token demand.
Jointly decides when waiting agent sessions should run on GPUs and which node should serve them. Scheduling accounts for tool-return readiness, time-decaying node cache value, and token demand.