3 papers
cs.CL2025
DuplexMamba: Enhancing Real-time Speech Conversations with Duplex and Streaming Capabilities
Xiangyu Lu, Wang Xu, Haoyu Wang +5
Real-time speech conversation is essential for natural and efficient human-machine interactions, requiring duplex and streaming capabilities. Traditional Transformer-based conversa…
cs.CL2025
SEO: Stochastic Experience Optimization for Large Language Models
Jitao Xu, Hongyun Zhou, Lei Shen +3
Large Language Models (LLMs) can benefit from useful experiences to improve their performance on specific tasks. However, finding helpful experiences for different LLMs is not obvi…
cs.LG2024
LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
Hongyun Zhou, Xiangyu Lu, Wang Xu +3
Low-Rank Adaptation (LoRA) is currently the most commonly used Parameter-efficient fine-tuning (PEFT) method, it introduces auxiliary parameters for each layer to fine-tune the pre…