6 papers
Is Your LLM Overcharging You? Tokenization, Transparency, and Incentives
Ander Artola Velasco, Stratis Tsirtsis, Nastaran Okati +1
State-of-the-art large language models require specialized hardware and substantial energy to operate. As a consequence, cloud-based services that provide access to large language…
Optimizing Social Utility in Sequential Experiments
Ander Artola Velasco, Stratis Tsirtsis, Manuel Gomez-Rodriguez
Regulatory approval of products in high-stakes domains such as drug development requires statistical evidence of safety and efficacy through large-scale randomized controlled trial…
Test-Time Compute Games
Ander Artola Velasco, Dimitrios Rontogiannis, Stratis Tsirtsis +1
Test-time compute has emerged as a promising strategy to enhance the reasoning abilities of large language models (LLMs). However, this strategy has in turn increased how much user…
Evaluation of Large Language Models via Coupled Token Generation
Nina Corvelo Benz, Stratis Tsirtsis, Eleni Straitouri +4
State of the art large language models rely on randomization to respond to a prompt. As an immediate consequence, a model may respond differently to the same prompt if asked multip…
Auditing Pay-Per-Token in Large Language Models
Ander Artola Velasco, Stratis Tsirtsis, Manuel Gomez-Rodriguez
Millions of users rely on a market of cloud-based services to obtain access to state-of-the-art large language models. However, it has been very recently shown that the de facto pa…
Narrowing Action Choices with AI Improves Human Sequential Decisions
Eleni Straitouri, Stratis Tsirtsis, Ander Artola Velasco +1
Recent work has shown that, in classification tasks, it is possible to design decision support systems that do not require human experts to understand when to cede agency to a clas…