AIAny
Icon for item

Program-as-Weights: A Programming Paradigm for Fuzzy Functions

Compiles natural-language function specifications into compact, locally-executable neural programs (PAW) that run on a small frozen interpreter; a 4B compiler emits LoRA adapters for a 0.6B runtime to provide offline, low-memory fuzzy text functions.

Introduction

Most day-to-day text processing tasks—intent routing, JSON repair, log triage, fuzzy search—are "fuzzy": they resist brittle rule systems but don't need a 30B model call per input. The paper's core insight is to turn a foundation model from a per-input problem solver into a tool builder: compile once into a small neural artifact and run that artifact locally and cheaply.

Information

  • Websitearxiv.org
  • OrganizationsUniversity of Waterloo, Cornell University, Harvard University
  • AuthorsWentao Zhang, Liliana Hotsko, Woojeong Kim, Pengyu Nie, Stuart Shieber, Yuntian Deng
  • Published date2026/07/02

More Items

Analyzes how proposer–solver loops in self-evolving search agents can develop shared errors (co-cheating) that inflate internal rewards; introduces Multi-Sample Verification and CrossFit (cross-fitted scoring with partitioned sources) to reduce false agreement and improve downstream search performance.

Uses a multimodal model's own critiques as privileged context and applies on-policy self-distillation over diffusion sampling trajectories to internalize corrective guidance, improving text-to-image generation without an external teacher; shows measurable gains on GenEval and GenEval2.

Evaluates multimodal memory in large audio language models by testing four acoustic evidence types and four memory operations across multi-session spoken histories, stratified across 8K–64K token context budgets.