6 papers
Grounded Token Initialization for New Vocabulary in LMs for Generative Recommendation
Daiwei Chen, Zhoutong Fu, Chengming Jiang +12
Language models (LMs) are increasingly extended with new learnable vocabulary tokens for domain-specific tasks, such as Semantic-ID tokens in generative recommendation. The standar…
From Features to Transformers: Redefining Ranking for Scalable Impact
Fedor Borisyuk, Lars Hertel, Ganesh Parameswaran +14
We present LiGR, a large-scale ranking framework developed at LinkedIn that brings state-of-the-art transformer-based modeling architectures into production. We introduce a modifie…
Semantic Search At LinkedIn
Fedor Borisyuk, Sriram Vasudevan, Muchen Wu +71
Semantic search with large language models (LLMs) enables retrieval by meaning rather than keyword overlap, but scaling it requires major inference efficiency advances. We present…
MixLM: High-Throughput and Effective LLM Ranking via Text-Embedding Mix-Interaction
Guoyao Li, Ran He, Shusen Jing +21
Large language models (LLMs) excel at capturing semantic nuances and therefore show impressive relevance ranking performance in modern recommendation and search systems. However, t…
Scaling Up Efficient Small Language Models Serving and Deployment for Semantic Job Search
Kayhan Behdin, Qingquan Song, Sriram Vasudevan +17
Large Language Models (LLMs) have demonstrated impressive quality when applied to predictive tasks such as relevance ranking and semantic search. However, deployment of such LLMs r…
LANTERN: Scalable Distillation of Large Language Models for Job-Person Fit and Explanation
Zhoutong Fu, Yihan Cao, Yi-Lin Chen +16
Large language models (LLMs) have achieved strong performance across a wide range of natural language processing tasks. However, deploying LLMs at scale for domain specific applica…