2 papers
cs.LG2025
Analysis on distribution and clustering of weight
Chunming Ye, Wenquan Tian, Yalan Gao +1
The study on architecture and parameter characteristics remains the hot topic in the research of large language models. In this paper we concern with the characteristics of weight…
cs.LG2025
Exploring and Reshaping the Weight Distribution in LLM
Chunming Ye, Songzhou Li, Xu Xu
The performance of Large Language Models is influenced by their characteristics such as architecture, model sizes, decoding methods and so on. Due to differences in structure or fu…