6 citations · 11 across the 17 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2023
DyCL: Dynamic Neural Network Compilation Via Program Rewriting and Graph Optimization
Simin Chen, Shiyi Wei, Cong Liu +1
DL compiler's primary function is to translate DNN programs written in high-level DL frameworks such as PyTorch and TensorFlow into portable executables. These executables can then…
cs.CL2023
Dynamic Transformers Provide a False Sense of Efficiency
Yiming Chen, Simin Chen, Zexin Li +4
Despite much success in natural language processing (NLP), pre-trained language models typically lead to a high computational cost during inference. Multi-exit is a mainstream appr…
cs.CL2022
LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Models
Xiaoning Feng, Xiaohong Han, Simin Chen +1
In this paper, we make the first attempt to understand and test potential computation efficiency robustness in state-of-the-art LLMs. By analyzing the working mechanism and impleme…