Showing cs.AIShow all
2 papers · 1 filter
cs.AI2025
OverFill: Two-Stage Models for Efficient Language Model Decoding
Woojeong Kim, Junxiong Wang, Jing Nathan Yan +2
Large language models (LLMs) excel across diverse tasks but face significant deployment challenges due to high inference costs. LLM inference comprises prefill (compute-bound) and…
cs.AI2024
SEAL: Suite for Evaluating API-use of LLMs
Woojeong Kim, Ashish Jagmohan, Aditya Vempaty
Large language models (LLMs) have limitations in handling tasks that require real-time access to external APIs. While several benchmarks like ToolBench and APIGen have been develop…