Studies train-time knowledge injection via hypernetworks that generate fixed LoRA adapters from large fact corpora, empirically characterizing power-law scaling across hypernetwork depth, width, and target model size and reporting improved OOD generalization.
Analyzes internal computation of text-to-image diffusion transformers and shows structural template tokens act as implicit semantic registers that maintain object identity during denoising. Introduces a causal interpretability framework (attention decomposition + targeted interventions) and a training-free pruning rule that cuts ~20% attention FLOPs for a ~1.4-point GenEval drop.