Pinned
I published Vol. 177 of "Top Information Retrieval Papers of the Week" on Substack. ๐ recsys.substack.com/p/searchjev-...
Sumit
@reachsumit.com
Senior MLE at Meta. Trying to keep up with the Information Retrieval domain! Blog: https://blog.reachsumit.com/ Newsletter: https://recsys.substack.com/
298 followers37 following3.9K posts
Pinned
I published Vol. 177 of "Top Information Retrieval Papers of the Week" on Substack. ๐ recsys.substack.com/p/searchjev-...
EmbeddingGemma 2: Unified and Efficient Multimodal Representations Google presents an open embedding model that maps text, images, audio, and video into one shared space, with modular encoders for smaller deployments. ๐ arxiv.org/abs/2610.37364 ๐จ๐ฝโ๐ป ai.google.dev/gemma/docs/e...
JevRec: Linguistic Encoding with Jev-like Decision Modeling for LLM-based Generative Recommendation Gives popular items shorter semantic IDs and long-tail items longer ones, and uses separate heads for predicting ID length and generating item codes. ๐ arxiv.org/abs/2610.36937
MAREval: A Multi-Agent Framework for Evaluating Natural Language Recommendation Explanations Walmart proposes a multi-agent LLM framework with planner, moderator and arbitrator agents for evaluating recommendation explanations in line with human judgments. ๐ arxiv.org/abs/2610.36389
QESChunker: A Single Objective Unifies Overlapping and Non-Overlapping Chunking for RAG Alibaba introduces a RAG chunker that sets boundaries from question-evidence pairs, using exact dynamic programming without overlap and greedy selection with overlap. ๐ arxiv.org/abs/2610.36557
The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation Uses features from a pretrained sparse autoencoder as the item vocabulary for generative recommendation. ๐ arxiv.org/abs/2610.36763 ๐จ๐ฝโ๐ป anonymous.4open.science/r/API-C1F9/
Natural Hard-Negative Mining from Positives for Instruction-Following Retrieval Builds instruction-following training data by promoting a retrieved negative via a new instruction, with the original positive as a hard negative. ๐ arxiv.org/abs/2610.36900
Do We Need an LLM to Know Why Sources Conflict? Decision Models for Knowledge-Conflict Typing in RAG Tests fast decision models for classifying why retrieved sources conflict. Most match Gemini 2.5 Flash at lower cost. ๐ arxiv.org/abs/2610.36915 ๐จ๐ฝโ๐ป github.com/Parv17k/deci...
PailitaoMMSearch2.0 Technical Report: Scaling Generative Retrieval to Unified End-to-End Multimodal Search Alibaba trains one vision-language model to map an image and a free-form request to product IDs, with adjustable reasoning budgets. ๐ arxiv.org/abs/2610.36958
KL-MOPD: Discrepancy-Aware Multi-Objective On-Policy Distillation for Generative Recommendation Weights each objective's teacher per token by its KL divergence from the student when distilling a generative recommender. ๐ arxiv.org/abs/2610.36973 ๐จ๐ฝโ๐ป github.com/Yandorn/KL-M...
Compote: Collapse-Resistant Multiple Hypothesis Learning For Sequential Recommendation Trains a multi-head sequential recommender with an annealed winner-takes-all objective, so each head covers a different part of the catalogue instead of collapsing. ๐ arxiv.org/abs/2610.37005
Tessera: Structure-Completed Evidence Units for Web Retrieval-Augmented Generation Introduces a training-free layer that rebuilds retrieved pages into small evidence units that keep their titles and table headers. ๐ arxiv.org/abs/2610.37080 ๐จ๐ฝโ๐ป github.com/sarendis56/T...
Rethinking Positional Encoding and Interaction Granularity for CTR Prediction Proposes a CTR model that encodes each behavior's sequence rank and its time relative to the target, and lets behaviors attend to each other within temporal groups. ๐ arxiv.org/abs/2610.37140
Coverage Under Contradiction: A Benchmark for Negation-Aware Retrieval Introduces a benchmark that edits documents to support negated claims, testing how retrievers handle evidence that conflicts with prior knowledge. ๐ arxiv.org/abs/2610.37162 ๐ค huggingface.co/datasets/pas...
Lossless Compression of Proximity Graph Indexes for Efficient Approximate Nearest Neighbors Search Compresses HNSW edge lists by reordering node IDs offline and using fast SIMD integer codecs, cutting memory with negligible effect on query latency. ๐ arxiv.org/abs/2610.37176
AutoRSE: Evaluating LLM Agents as Recommendation Engineers for Self-Evolving Recommender Systems Benchmarks LLM agents on six recommendation tasks. Their gains come mostly from tuning and ensembling, not new algorithms. ๐ arxiv.org/abs/2610.37228 ๐จ๐ฝโ๐ป github.com/Ray-Tiann/Au...
LESSRec: Level-Specific History Modeling for Semantic ID-Based Recommendation Finds that history tokens at the target token's semantic level are more informative. Proposes encoding each level separately & limiting attention to the matching level. ๐ arxiv.org/abs/2610.37286
REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation Adds explicit item relations to generative recommendation through semantic pretraining, adjacent-item attention, and distillation from a discriminative teacher. ๐ arxiv.org/abs/2610.37584
EffBench: A Holistic Efficiency Benchmark for CTR Models Introduces a benchmark that compares CTR models on efficiency as well as accuracy, with latency and throughput metrics and a profiling tool that finds bottlenecks. ๐ doi.org/10.1145/3857... ๐จ๐ฝโ๐ป github.com/Yeedzhi/EffB...
ER-RAG: Enhance RAG with ER-Based Unified Modeling of Heterogeneous Data Source Introduces a RAG framework that retrieves from web pages, databases and knowledge graphs through one shared API, with a trained module that picks which sources to query. ๐ doi.org/10.1145/3860...
SearchHorizonBench: A Benchmark for Search Value in AI Agents Introduces a benchmark for judging when an extra web search is worth its cost for an AI agent, using paired runs that either answer directly or search further from the same point. ๐ arxiv.org/abs/2610.34714 ๐จ๐ฝโ๐ป github.com/EthanNing/Se...
MuSID-KD: Multigranularity Knowledge Distillation for Generative Recommendation with Semantic IDs Improves distillation of semantic ID recommenders by aligning candidate group distributions at each ID level. ๐ arxiv.org/abs/2610.35218 ๐จ๐ฝโ๐ป anonymous.4open.science/r/m7k2-revie...
Can System-1-Style Decision Models Replace Dedicated Rerankers in RAG? A Systems Evaluation Tests decision models as reranker replacements. Truncation makes some competitive, but a tuned dedicated reranker is still faster and uses far less GPU memory. ๐ arxiv.org/abs/2610.34816
Memory Tax: Dissecting the Net Value of Agent Memory Finds that many agent memory systems score below naive RAG over raw history. Splits memory's net value into benefit and tax. ๐ arxiv.org/abs/2610.34073 ๐จ๐ฝโ๐ป hexuan21.github.io/MemoryTax ๐ค huggingface.co/datasets/hex...
PinGER: Token-Efficient Generative Retrieval with Semantic IDs Pinterest presents its generative retriever that replaces nearest-neighbor search. An asymmetric attention mask trains with semantic ID supervision but serves only one token per item. ๐ arxiv.org/abs/2610.33435
Rethinking Retrieval in the Long-Context Era: Training-Free Semantic Trees for Adaptive Context Construction Builds a training-free semantic tree of a long document and gives the LLM only relevant sections. ๐ arxiv.org/abs/2610.34146 ๐จ๐ฝโ๐ป anonymous.4open.science/r/treefuse-E...
LoopGR: Parameter-Efficient Scaling for Generative Recommendation via Recurrent Depth Reuses a shared decoder and a light context updater in recurrent loops to add depth without adding parameters, then distills it into a cheaper low-loop student. ๐ arxiv.org/abs/2610.34157
Theoretically Sound Item Similarity Measures for Recommender Systems Derives item similarity measures from Bernoulli and multinomial Naive Bayes, and shows cosine similarity solves a specific optimization problem. ๐ arxiv.org/abs/2610.34402 ๐จ๐ฝโ๐ป github.com/noah-daniels...
Knowing When the Evidence Is Enough: Requirement-Directed Search with Horn-Closure Certificates Decides whether to answer, search again, or abstain using a per-query requirement hypergraph and Horn closure instead of having a model judge the evidence. ๐ arxiv.org/abs/2610.34684
SLIDE: Search-to-List Item Distillation for Single-Rollout Generative Retrieval Distills a teacher model's offline beam-search results into list-wise targets, so a smaller generative retrieval model can produce a full ranked list in one greedy pass. ๐ arxiv.org/abs/2610.34764
Octen-WebGR: Scaling Generative Retrieval to 200 Million Web Pages Introduces a generative retriever that indexes 201 million web pages with two-token identifiers for navigational search. ๐ arxiv.org/abs/2610.35256 ๐จ๐ฝโ๐ป github.com/Octen-Team ๐ค huggingface.co/Octen
Unified Heterogeneous Feature Interaction via Effective-Rank Scaling for Recommender Systems Introduces a ranking model that combines behavior sequence modeling and feature interaction in a single backbone for multi-scenario recommendation. ๐ arxiv.org/abs/2610.35318
Towards a Unified Framework of Optimal Input-Side Dimensional Configuration for Deep CTR Prediction Introduces a framework that jointly selects samples, features, and embedding units for CTR prediction, using optimal transport to align the levels. ๐ arxiv.org/abs/2610.35695
Do Similarity Measures Measure Similarity? How User Activity Creates Phantom Correlation in Recommender Systems Shows that differences in user activity alone make items look similar, even when users share no taste. ๐ arxiv.org/abs/2610.35765 ๐จ๐ฝโ๐ป github.com/Mfavier91/Ph...
ACARe: Agent-Context-Aware Reranker for Iterative Search Introduces a compact reranker for search agents that scores documents using the original question and reasoning trace, not just the agent's sub-query, improving retrieval and cutting searches. ๐ arxiv.org/abs/2610.35840
Retriever-Free Retrieval: Navigating Documents with Decision Models Retrieves by walking down a corpus hierarchy, with a decision model scoring all candidates at each level in a single pass, without generating tokens. ๐ arxiv.org/abs/2610.35868
Beyond Post-Hoc Rewards: Privileged Reasoning Exploration for Multimodal Embeddings Uses training-time positive and negative candidates to guide reasoning exploration for multimodal embeddings, with input-only inference. ๐ arxiv.org/abs/2610.32474
TGR-EvoDAG: A DAG-based Multi-Agent Code Evolution Framework for Generative Recommendation on Tencent Tencent introduces a multi-agent framework that evolves generative recommendation code as a DAG of branches, with GPU cost planning for each pipeline stage. ๐ arxiv.org/abs/2610.32326
MICE to Meet You: From Re-ranking Only to End-to-End Retrieval Introduces MICE-P, which indexes MICE document representations with PLAID to build an end-to-end retrieval pipeline with cross-encoder-like effectiveness. ๐ arxiv.org/abs/2610.31932 ๐จ๐ฝโ๐ป github.com/xpmir/mice
From Item Scores to Semantic Tokens: Test-Time Collaborative Adaptation for Generative Recommendation Introduces a training-free way to use discriminative item scores to guide beam search in a frozen generative recommender before prefixes get pruned. ๐ arxiv.org/abs/2610.32098
PersonalQuery-Benchmark: Evaluating Retrieval Robustness to Personalized User Expression Differences Introduces a benchmark where personalized query syntax and writing errors shift rankings for a fixed information need. ๐ arxiv.org/abs/2610.32164 ๐จ๐ฝโ๐ป github.com/cpxjazz123/P...
System One Models Are Not Better Rerankers Finds that decision (System One) fine-tuning never beats plain reranker fine-tuning on the same Qwen backbones, and its calibration advantage depends on the question wording. ๐ arxiv.org/abs/2610.32318 ๐จ๐ฝโ๐ป github.com/KanishkaGD/d...
Agentic Memory Management Is the Next Frontier of Information Retrieval Presents a perspective paper arguing that managing an AI agent's memory is a natural extension of IR. Also shares a memory framework, a comparison with classic IR, and a research agenda. ๐ arxiv.org/abs/2610.32464
Agentic Memory Management Is the Next Frontier of Information Retrieval Presents a perspective paper arguing that managing an AI agent's memory is a natural extension of IR. Also shares a memory framework, a comparison with classic IR, and a research agenda. ๐ arxiv.org/abs/2610.32464
Knowledge Distillation across Item and Code Spaces for Parallel Generative Recommendation Proposes two objectives that distill a sequential recommender's item scores into a parallel semantic ID model, matching item distributions or code marginals. ๐ arxiv.org/abs/2610.32943
Separating Thinking from Spelling for Efficient Generative Recommendation Presents a GR system where the backbone reads the user history once into a compact concept and a light decoder runs the entire semantic ID beam search, which cuts serving cost. ๐ arxiv.org/abs/2610.32980
Safe and Sufficient Caching: Per-Request Validated Evidence Reuse for Production Retrieval-Augmented Generation Amazon caches evidence chunks and checks access and source freshness before reuse, cutting latency and retrieval cost with zero invalid reuse. ๐ www.amazon.science/publications...
TransX Technical Report: Scaling Sequence Transduction for Recommendation LinkedIn presents a recommender that separates history encoding, behavior memory, and candidate scoring so most work runs offline, letting models scale without raising serving cost. ๐ arxiv.org/abs/2610.20913
Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval Trains a retrieval model to reason step by step and stop once extra reasoning stops helping, cutting generation cost and latency. ๐ arxiv.org/abs/2610.21030 ๐จ๐ฝโ๐ป github.com/yingtaoluo/A...
Beyond Retrieval Failure: Understanding Why LLMs Miss Evidence in Multi-Hop RAG Finds that missing evidence in multi-hop RAG often stems from search drift, not retriever limits. ๐ arxiv.org/abs/2610.21184
RecSoup: Efficient Model Merging Approach for Controllable Multi-Objective Recommendation Merges objective-specific recommenders after pruning conflicting parameters, so trade-offs can be tuned without retraining. ๐ arxiv.org/abs/2610.21220 ๐จ๐ฝโ๐ป github.com/35798642/REC...