AIAny
Icon for item

LAMAR: An Open Language-Aware Multilingual Alignment Reranker

Reranks multilingual retrieval candidates to favour documents that are both semantically relevant and written in the same language as the query, using English-anchored relevance distillation and preference alignment; excels in language-coherence tests while remaining competitive on standard multilingual reranking benchmarks.

Introduction

Why this matters Most multilingual retrieval pipelines treat semantic relevance and document language as independent signals, which can produce answers in a different language than the user query—problematic for downstream generation in RAG systems. LAMAR focuses on the often-overlooked objective of language coherence: given semantically equivalent documents across languages, a reranker should prefer the one in the query language without sacrificing relevance.

Key Findings
  • English-anchored relevance distillation: uses English-grounded scores to make relevance assessments consistent across multilingual inputs, reducing cross-language scoring drift.
  • Preference alignment for language coherence: learns to tilt rankings toward documents that match the query language while retaining semantic relevance, producing more language-consistent top results.
  • Empirical performance: in a controlled language-coherence experiment LAMAR achieves the best overall and per-language results; on established multilingual reranking benchmarks it remains competitive, and in practical first-stage retrieval settings it improves end-to-end retrieval metrics when used to rerank candidates.
Who it's for and trade-offs

Great fit if you build multilingual RAG or search systems where answer language matters (user-facing QA, multilingual assistants, cross-lingual search) and you need a reranker that enforces language coherence without major drops in relevance. Look elsewhere if your pipeline requires purely language-agnostic aggregation (e.g., cross-lingual pooling where language diversity is preferred) or if latency/compute constraints cannot accommodate a cross-encoder reranker.

Method sketch

The model is a multilingual cross-encoder trained to combine semantic relevance and language-preference signals. Training uses an English-anchored teacher to harmonize relevance scores across languages, plus an alignment objective that biases rankings toward query-language documents. The paper evaluates both controlled language-coherence settings and standard multilingual reranking benchmarks to show the trade-offs between coherence and raw relevance.

Information

  • Websitearxiv.org
  • AuthorsSeongtae Hong, Youngjoon Jang, Jungseob Lee, Seungyoon Lee, Heuiseok Lim
  • Published date2026/07/24

More Items

Injects corpus knowledge into a language model’s intermediate layers, avoiding explicit retrieval at inference. It predicts shared memory per text chunk and reduces the retrieval work needed to construct training targets while keeping the backbone frozen.

Improves length generalization in looped language models by aligning each iteration with a specific intermediate state and anchoring recurrent-state scale. On swap-S₅, a model trained on up to 32 moves reaches 95.5% accuracy at 512 moves.

Embeds an agent's reasoning together with its search query to improve retrieval. Trains a 4B embedding model on synthesized deep-research trajectories, helping preserve intent across multi-step searches.