TRIM: Token Reduction and Inference Modeling for Cost-Effective Language Generation

Alfredo Garrachón Ruiz, Tomás de la Rosa, Daniel Borrajo

The high inference cost of Large Language Models (LLMs) poses challenges, especially for tasks requiring lengthy outputs. However, natural language often contains redundancy, which…