Studies looping shared transformer layers in Mixture-of-Experts models under matched budgets and proposes SMELT: loop the middle half twice while matching per-token FLOPs, non-embedding parameters, and KV cache. Shows 6.8–18.0% training-FLOPs savings on the compute-optimal frontier, stronger downstream gains on code and long-context tasks.
Turns sparse per-student records into individualized simulators that both reproduce a student’s responses and update them under tutor guidance using pooled LLM pretraining followed by per-student specialization; releases StudentSimEval and reference simulators across chess, L2 writing, and math.