Most day-to-day text processing tasks—intent routing, JSON repair, log triage, fuzzy search—are "fuzzy": they resist brittle rule systems but don't need a 30B model call per input. The paper's core insight is to turn a foundation model from a per-input problem solver into a tool builder: compile once into a small neural artifact and run that artifact locally and cheaply.
Program-as-Weights: A Programming Paradigm for Fuzzy Functions
Compiles natural-language function specifications into compact, locally-executable neural programs (PAW) that run on a small frozen interpreter; a 4B compiler emits LoRA adapters for a 0.6B runtime to provide offline, low-memory fuzzy text functions.
Introduction
Information
- Websitearxiv.org
- OrganizationsUniversity of Waterloo, Cornell University, Harvard University
- AuthorsWentao Zhang, Liliana Hotsko, Woojeong Kim, Pengyu Nie, Stuart Shieber, Yuntian Deng
- Published date2026/07/02
More Items
Analyzes how proposer–solver loops in self-evolving search agents can develop shared errors (co-cheating) that inflate internal rewards; introduces Multi-Sample Verification and CrossFit (cross-fitted scoring with partitioned sources) to reduce false agreement and improve downstream search performance.
Uses a multimodal model's own critiques as privileged context and applies on-policy self-distillation over diffusion sampling trajectories to internalize corrective guidance, improving text-to-image generation without an external teacher; shows measurable gains on GenEval and GenEval2.
Evaluates multimodal memory in large audio language models by testing four acoustic evidence types and four memory operations across multi-session spoken histories, stratified across 8K–64K token context budgets.