RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference

Yige Xu, Xu Guo, Zhiwei Zeng +1

Large language models (LLMs) have brought a great breakthrough to the natural language processing (NLP) community, while leading the challenge of handling concurrent customer queri…