6 papers
Robust Batch-Level Query Routing for Large Language Models under Cost and Capacity Constraints
Jelena Markovic-Voronov, Kayhan Behdin, Yuanda Xu +3
We study the problem of routing queries to large language models (LLMs) under cost, GPU resources, and concurrency constraints. Prior per-query routing methods often fail to contro…
Semantic Search At LinkedIn
Fedor Borisyuk, Sriram Vasudevan, Muchen Wu +71
Semantic search with large language models (LLMs) enables retrieval by meaning rather than keyword overlap, but scaling it requires major inference efficiency advances. We present…
HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling
Hexiong Yang, Mingrui Chen, Huaibo Huang +4
Inspired by the great success of Masked Language Modeling (MLM) in the natural language domain, the paradigm of self-supervised pre-training and fine-tuning has also achieved remar…
Can Large Language Models Become Policy Refinement Partners? Evidence from China's Social Security Studies
Jinghan Ke, Zheng Zhou, Yuxuan Zhao
The rapid development of large language models (LLMs) is reshaping operational paradigms across multidisciplinary domains. LLMs' emergent capability to synthesize policy-relevant i…
Iterative Tree Analysis for Medical Critics
Zenan Huang, Mingwei Li, Zheng Zhou +1
Large Language Models (LLMs) have been widely adopted across various domains, yet their application in the medical field poses unique challenges, particularly concerning the genera…
Does the Order of Fine-tuning Matter and Why?
Qihong Chen, Jiawei Li, Hyunjae Suh +5
To improve the performance on a target task, researchers have fine-tuned language models with an intermediate task before the target task of interest. However, previous works have…