4 citations · 5 across the 9 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Intra-Prompt Parallel Decoding for Common-Context Question Answering
Theodore Glavas, Nikhita Vedula, Dushyanta Dhyani +3
In common-context question answering (CCQA) tasks, multiple input questions share a common context to base their answers from. However, Large Language Models typically generate eac…
cs.CL2024
Dynamic layer selection in decoder-only transformers
Theodore Glavas, Joud Chataoui, Florence Regol +4
The vast size of Large Language Models (LLMs) has prompted a search to optimize inference. One effective approach is dynamic inference, which adapts the architecture to the sample-…