Category
Explore by categories
Interleaves chain-of-thought reasoning with tool-using actions in one LLM loop: the model plans, queries a source like Wikipedia, then revises from results. Cuts hallucination versus reasoning-only prompting and beats trained agents on interactive tasks.
A graph-based RAG framework pairing a knowledge graph with vector retrieval and a dual-level (low/high) query mode. New documents merge into the graph via set operations instead of triggering a rebuild, cutting the cost of keeping the index current.
First model to make a decoder dynamically focus on different source words instead of cramming a whole sentence into one fixed vector — the soft-alignment idea that became "attention" and, three years later, powered the Transformer.
End-to-end encoder–decoder using deep LSTMs to map variable-length input sequences to output sequences; demonstrated competitive English→French translation (BLEU 34.8) and improved optimization by reversing source sentences, showing strong handling of long sentences.
The 2017 paper that replaced recurrence with pure self-attention, making sequence models fully parallelizable — and, almost as a side effect, laying the architectural foundation for nearly every large language model that followed, from BERT to GPT.
Embeds multi-head self-attention inside an LSTM-style memory, so stored memories can attend to one another instead of just sitting in separate slots — sharpening relational reasoning and topping WikiText-103, Project Gutenberg, and GigaWord.
Pre-trains a deep bidirectional Transformer encoder with masked-language-modeling and next-sentence prediction, then fine-tunes one model on 11 NLP tasks, reaching state-of-the-art on GLUE, SQuAD, and MultiNLI with little task-specific tuning.
Compares standard human psychometric questionnaires (PVQ, BFI) with generation‑based profiling to test whether questionnaires predict real LLM responses. Finds big divergences: questionnaires exploit lexical cues and elicit alignment‑consistent answers, mischaracterizing LLM behavior on everyday queries.
An open large language model pairing DeepSeek Sparse Attention (DSA) for cheaper long-context inference with a scaled RL pipeline. Authors claim parity with GPT-5, with a high-compute Speciale variant surpassing it and rivaling Gemini-3.0-Pro on reasoning.
Learns a text-conditioned flow (a conditional velocity field) in LLM residual activations to steer frozen models at inference by partially transporting and regenerating activations under target textual conditions — enabling unified control over persona, style, truthfulness, compositional constraints, and activation-space classification.
Introduces Draft-OPD, an on-policy distillation method for training lightweight draft models used in speculative decoding — it focuses learning on draft-induced errors via target-assisted rollouts and replay, improving acceptance length and enabling >5× lossless LLM inference acceleration.
Analyzes when masking stale observations improves long-horizon search agents and why, identifying an asymmetric inverted-U relationship between masking benefit, retriever quality, and model capacity; explains a token-for-turn trade-off and releases evaluation scaffolds and trajectories.