Runs LFM3-1.7B locally on CPUs and GPUs using the GGUF format. Multiple quantizations are available, including a Q4_0 checkpoint trained to recover accuracy lost during quantization.
Jointly decides when waiting agent sessions should run on GPUs and which node should serve them. Scheduling accounts for tool-return readiness, time-decaying node cache value, and token demand.
Studies how to route tasks to suitable models or policies across general-purpose AI systems while balancing quality and compute cost. Evaluations across 25 benchmarks and over 374,000 runs quantify the resulting capability and efficiency gains.