2 papers
cs.LG2025
LZ Penalty: An information-theoretic repetition penalty for autoregressive language models
Antonio A. Ginart, Naveen Kodali, Jason Lee +3
We introduce the LZ penalty, a penalty specialized for reducing degenerate repetitions in autoregressive language models without loss of capability. The penalty is based on the cod…
cs.AI2024
Asynchronous Tool Usage for Real-Time Agents
Antonio A. Ginart, Naveen Kodali, Jason Lee +3
While frontier large language models (LLMs) are capable tool-using agents, current AI systems still operate in a strict turn-based fashion, oblivious to passage of time. This synch…