AIAny
Icon for item

Program-as-Weights: A Programming Paradigm for Fuzzy Functions

Compiles natural-language function specifications into compact, locally-executable neural programs (PAW) that run on a small frozen interpreter; a 4B compiler emits LoRA adapters for a 0.6B runtime to provide offline, low-memory fuzzy text functions.

Introduction

Most day-to-day text processing tasks—intent routing, JSON repair, log triage, fuzzy search—are "fuzzy": they resist brittle rule systems but don't need a 30B model call per input. The paper's core insight is to turn a foundation model from a per-input problem solver into a tool builder: compile once into a small neural artifact and run that artifact locally and cheaply.

Information

  • Websitearxiv.org
  • OrganizationsUniversity of Waterloo, Cornell University, Harvard University
  • AuthorsWentao Zhang, Liliana Hotsko, Woojeong Kim, Pengyu Nie, Stuart Shieber, Yuntian Deng
  • Published date2026/07/02

More Items

Separates knowledge storage (a global Memory) from iterative reasoning operators (multiple Reasoners) to improve knowledge compression and inference efficiency; reports a 7B model matching baseline with 62.6% of training data and a 35B Intern-S2-Mobius achieving ~4x end-to-end speedup.

Frames LLM routing as a sequential decision process and introduces LLMRouter plus the xRouteBench benchmark to develop, evaluate, and deploy learned routing policies across heterogeneous LLMs, optimizing response quality versus inference cost.

Evaluates whether LLM-driven storyteller agents preserve long-horizon logical consistency under adversarial player interventions. Introduces NCP-Bench (100 movie-derived narrative environments) with structured trajectory/commitments and automatic violation checks; finds strong LLMs often contradict themselves across multi-turn interactions.