4 papers
Edge-Deployable LLM Fine-Tuning on a Single GPU for Telecom Network Troubleshooting
Chenhua Shi, Bhavika Jalli, John Zou +4
Telecom troubleshooting at edge sites requires low-latency model responses and localized model adaptation to satisfy operational and data sovereignty requirements. However, deployi…
LEAP: Layer-skipping Efficiency via Adaptive Progression for Vision Transformer Distillation
Jiaqi Zhang, Ashton Lee, Anthony Wong +3
Vision Foundation Models (VFMs) with Vision Transformer (ViT) backbones, such as DINOv2, have become essential for downstream tasks like object recognition and semantic segmentatio…
Think Less, Label Better: Multi-Stage Domain-Grounded Synthetic Data Generation for Fine-Tuning Large Language Models in Telecommunications
Chenhua Shi, Gregor Macdonald, Bhavika Jalli +4
The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through hum…
FastDINOv2: Frequency Based Curriculum Learning Improves Robustness and Training Speed
Jiaqi Zhang, Juntuo Wang, Zhixin Sun +2
Large-scale vision foundation models such as DINOv2 boast impressive performances by leveraging massive architectures and training datasets. But numerous scenarios require practiti…