Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity
Mutian He, Philip N. Garner
Architectures such as Linformer and Mamba have recently emerged as competitive linear time replacements for transformers. However, corresponding large pretrained models are often u…
cs.CL2024
Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization
Mutian He, Tianqing Fang, Weiqi Wang +1
Conceptualization, or viewing entities and situations as instances of abstract concepts in mind and making inferences based on that, is a vital component in human intelligence for…