2 papers
cs.CL2026
Breaking the Autoregressive Chain: Hyper-Parallel Decoding for Efficient LLM-Based Attribute Value Extraction
Theodore Glavas, Nikhita Vedula, Dushyanta Dhyani +2
Some text generation tasks, such as Attribute Value Extraction (AVE), require decoding multiple independent sequences from the same document context. While standard autoregressive…
cs.CL2024
Dynamic layer selection in decoder-only transformers
Theodore Glavas, Joud Chataoui, Florence Regol +4
The vast size of Large Language Models (LLMs) has prompted a search to optimize inference. One effective approach is dynamic inference, which adapts the architecture to the sample-…