4 papers
Humanity's Last Exam
Long Phan, Alice Gatti, Ziwen Han +1144
Benchmarks are important tools for tracking the rapid advancements in large language model (LLM) capabilities. However, benchmarks are not keeping pace in difficulty: LLMs now achi…
Encode Once, Decode Never: Reusing Audio LM Internals for Efficient Temporal Localization
Joesph An, Joseph An, Phillip Keung +3
Audio language models process input audio into rich frame-level representations, but the standard approach to temporal localization generates timestamps as sequences of text tokens…
System 1&2 Synergy via Dynamic Model Interpolation
Chenxu Yang, Qingyi Si, Chong Tian +6
Training a unified language model that adapts between intuitive System 1 and deliberative System 2 remains challenging due to interference between their cognitive modes. Recent stu…
CEBench: A Benchmarking Toolkit for the Cost-Effectiveness of LLM Pipelines
Wenbo Sun, Jiaqi Wang, Qiming Guo +3
Online Large Language Model (LLM) services such as ChatGPT and Claude 3 have transformed business operations and academic research by effortlessly enabling new opportunities. Howev…