4 papers · 1 filter
BriLLM: Brain-inspired Large Language Model
Hai Zhao, Hongqiu Wu, Dongjie Yang +2
We introduce BriLLM, a brain-inspired large language model that fundamentally redefines the foundations of machine learning through its implementation of Signal Fully-connected flo…
How Deep is Love in LLMs' Hearts? Exploring Semantic Size in Human-like Cognition
Yao Yao, Yifei Yang, Xinbei Ma +4
How human cognitive abilities are formed has long captivated researchers. However, a significant challenge lies in developing meaningful methods to measure these complex processes.…
Are LLMs Aware that Some Questions are not Open-ended?
Dongjie Yang, Hai Zhao
Large Language Models (LLMs) have shown the impressive capability of answering questions in a wide range of scenarios. However, when LLMs face different types of questions, it is w…
PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
Dongjie Yang, XiaoDong Han, Yan Gao +3
Large Language Models (LLMs) have shown remarkable comprehension abilities but face challenges in GPU memory usage during inference, hindering their scalability for real-time appli…