QTALE: Quantization-Robust Token-Adaptive Layer Execution for LLMs

Kanghyun Noh, Jinheon Choi, Yulhwa Kim

Large language models (LLMs) demand substantial computational and memory resources, posing challenges for efficient deployment. Two complementary approaches have emerged to address…