5 papers
LZ Penalty: An information-theoretic repetition penalty for autoregressive language models
Antonio A. Ginart, Naveen Kodali, Jason Lee +3
We introduce the LZ penalty, a penalty specialized for reducing degenerate repetitions in autoregressive language models without loss of capability. The penalty is based on the cod…
Cross-Modal State-Space Graph Reasoning for Structured Summarization
Hannah Kim, Sofia Martinez, Jason Lee
The ability to extract compact, meaningful summaries from large-scale and multimodal data is critical for numerous applications, ranging from video analytics to medical reports. Pr…
Shifting Attention to You: Personalized Brain-Inspired AI Models
Stephen Chong Zhao, Yang Hu, Jason Lee +4
The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computationa…
Processing and Analyzing Real-World Driving Data: Insights on Trips, Scenarios, and Human Driving Behaviors
Jihun Han, Dominik Karbowski, Ayman Moawad +5
Analyzing large volumes of real-world driving data is essential for providing meaningful and reliable insights into real-world trips, scenarios, and human driving behaviors. To thi…
Asynchronous Tool Usage for Real-Time Agents
Antonio A. Ginart, Naveen Kodali, Jason Lee +3
While frontier large language models (LLMs) are capable tool-using agents, current AI systems still operate in a strict turn-based fashion, oblivious to passage of time. This synch…