5 papers
GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning
Trung-Anh Dang, Duy-Cuong Bui, Ngoc-Son Vu +2
Continual learning faces the persistent challenge of catastrophic forgetting, where sequential task updates degrade previously acquired knowledge. While prompt-based methods integr…
Customizing an LLM for Enterprise Software Engineering
Aditya Kini, Satish Chandra, Milad Hashemi +15
Enterprise software development is a continuous evolutionary process, characterized by incremental additions, architectural revisions, production deployments and rigorous maintenan…
SAMix: Calibrated and Accurate Continual Learning via Sphere-Adaptive Mixup and Neural Collapse
Trung-Anh Dang, Vincent Nguyen, Ngoc-Son Vu +1
While most continual learning methods focus on mitigating forgetting and improving accuracy, they often overlook the critical aspect of network calibration, despite its importance.…
Smart Paste: Automatically Fixing Copy/Paste for Google Developers
Vincent Nguyen, Guilherme Herzog, José Cambronero +4
Manually editing pasted code is a long-standing developer pain point. In internal software development at Google, we observe that code is pasted 4 times more often than it is manua…
Memory-efficient Continual Learning with Neural Collapse Contrastive
Trung-Anh Dang, Vincent Nguyen, Ngoc-Son Vu +1
Contrastive learning has significantly improved representation quality, enhancing knowledge transfer across tasks in continual learning (CL). However, catastrophic forgetting remai…