23.6k citations
- Carnegie Mellon UniversityUS49 papers
- Google (United States)US37 papers
- California Institute of TechnologyUS33 papers
- Amazon (Germany)DE32 papers
- University of Illinois Urbana-ChampaignUS22 papers
- Microsoft (United States)US20 papers
- Stanford UniversityUS20 papers
- The University of Texas at AustinUS20 papers
- University of California, Los AngelesUS20 papers
- University of California, Santa BarbaraUS19 papers
- University of WashingtonUS19 papers
- Georgia Institute of TechnologyUS17 papers
6 papers · 2 filters
LLMCache: Layer-Wise Caching Strategies for Accelerated Reuse in Transformer Inference
Harsh Vardhan Bansal
Transformer-based language models have achieved remarkable performance across a wide range of tasks, yet their high inference latency poses a significant challenge for real-timeand…
Zero-Shot Cross-Lingual Transfer using Prefix-Based Adaptation
Snegha A, Sayambhu Sen, Piyush Singh Pasi +2
With the release of new large language models (LLMs) like Llama and Mistral, zero-shot cross-lingual transfer has become increasingly feasible due to their multilingual pretraining…
An Expert-grounded benchmark of General Purpose LLMs in LCA
Artur Donaldson, Bharathan Balaji, Cajetan Oriekezie +2
Purpose: Artificial intelligence (AI), and in particular large language models (LLMs), are increasingly being explored as tools to support life cycle assessment (LCA). While demons…
FeynTune: Large Language Models for High-Energy Theory
Paul Richmond, Prarit Agarwal, Borun Chowdhury +2
We present specialized Large Language Models for theoretical High-Energy Physics, obtained as 20 fine-tuned variants of the 8-billion parameter Llama-3.1 model. Each variant was tr…
RAGPPI: RAG Benchmark for Protein-Protein Interactions in Drug Discovery
Youngseung Jeon, Ziwen Li, Thomas Li +3
Retrieving the biological impacts of protein-protein interactions (PPIs) is essential for target identification (Target ID) in drug development. Given the vast number of proteins i…
Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models
Vijeta Deshpande, Debasmita Ghose, John D. Patterson +2
Diverse language model responses are crucial for creative generation, open-ended tasks, and self-improvement training. We show that common diversity metrics, and even reward models…