5 citations · 5 across the 6 of their papers we have counts for
4 papers · 1 filter
ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows
Penghao Wang, Yuhao Zhou, Mengxuan Wu +12
As large language models (LLMs) advance, the ultimate vision for their role in science is emerging: we could build an AI collaborator to effectively assist human beings throughout…
Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge
Penghao Wang, Yuhao Zhou, Mengxuan Wu +3
State-space models (SSMs) have emerged as promising alternatives to Transformers for sequence modeling. However, training competitive SSMs from scratch remains computationally inte…
Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights
Zhiyuan Liang, Dongwen Tang, Yuhao Zhou +11
Modern Parameter-Efficient Fine-Tuning (PEFT) methods such as low-rank adaptation (LoRA) reduce the cost of customizing large language models (LLMs), yet still require a separate o…
PRIOR: Personalized Prior for Reactivating the Information Overlooked in Federated Learning
Mingjia Shi, Yuhao Zhou, Kai Wang +4
Classical federated learning (FL) enables training machine learning models without sharing data for privacy preservation, but heterogeneous data characteristic degrades the perform…