24 citations · 36 across the 5 of their papers we have counts for
5 papers
Mid-Training of Large Language Models: A Survey
Kaixiang Mo, Yuxin Shi, Weiwei Weng +4
Large language models (LLMs) are typically developed through large-scale pre-training followed by task-specific fine-tuning. Recent advances highlight the importance of an intermed…
Cross-Domain Continual Learning via CLAMP
Weiwei Weng, Mahardhika Pratama, Jie Zhang +3
Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural netw…
Metric-oriented Speech Enhancement using Diffusion Probabilistic Model
Chen Chen, Yuchen Hu, Weiwei Weng +1
Deep neural network based speech enhancement technique focuses on learning a noisy-to-clean transformation supervised by paired training data. However, the task-specific evaluation…
Autonomous Cross Domain Adaptation under Extreme Label Scarcity
Weiwei Weng, Mahardhika Pratama, Choiru Za'in +4
A cross domain multistream classification is a challenging problem calling for fast domain adaptations to handle different but related streams in never-ending and rapidly changing…
Continual Learning via Inter-Task Synaptic Mapping
Mao Fubing, Weng Weiwei, Mahardhika Pratama +1
Learning from streaming tasks leads a model to catastrophically erase unique experiences it absorbs from previous episodes. While regularization techniques such as LWF, SI, EWC hav…