18 citations · 50 across the 11 of their papers we have counts for
12 papers
Domain-Specific Data Synthesis for LLMs via Minimal Sufficient Representation Learning
Tong Ye, Hang Yu, Tengfei Ma +6
Large Language Models have demonstrated remarkable progress in general-purpose capabilities and can achieve strong performance in specific domains through fine-tuning on domain-spe…
QuitoBench: A High-Quality Open Time Series Forecasting Benchmark
Siqiao Xue, Zhaoyang Zhu, Wei Zhang +7
Time series forecasting is critical across finance, healthcare, and cloud computing, yet progress is constrained by a fundamental bottleneck: the scarcity of large-scale, high-qual…
LAMDAS: LLM as an Implicit Classifier for Domain-specific Data Selection
Jian Wu, Hang Yu, Bingchang Liu +4
Adapting large language models (LLMs) to specific domains often faces a critical bottleneck: the scarcity of high-quality, human-curated data. While large volumes of unchecked data…
Code Graph Model (CGM): A Graph-Integrated Large Language Model for Repository-Level Software Engineering Tasks
Hongyuan Tao, Ying Zhang, Zhenhao Tang +12
Recent advances in Large Language Models (LLMs) have shown promise in function-level code generation, yet repository-level software engineering tasks remain challenging. Current so…
CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models
Zi Gong, Hang Yu, Cong Liao +3
Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, pr…
Rodimus*: Breaking the Accuracy-Efficiency Trade-Off with Efficient Attentions
Zhihao He, Hang Yu, Zi Gong +3
Recent advancements in Transformer-based large language models (LLMs) have set new standards in natural language processing. However, the classical softmax attention incurs signifi…
GALLa: Graph Aligned Large Language Models for Improved Source Code Understanding
Ziyin Zhang, Hang Yu, Shijie Li +3
Programming languages possess rich semantic information - such as data flow - that is represented by graphs and not available from the surface form of source code. Recent code lang…
MFTCoder: Boosting Code LLMs with Multitask Fine-Tuning
Bingchang Liu, Chaoyu Chen, Cong Liao +9
Code LLMs have emerged as a specialized research field, with remarkable studies dedicated to enhancing model's coding capabilities through fine-tuning on pre-trained models. Previo…
Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code
Ziyin Zhang, Chaoyu Chen, Bingchang Liu +5
In this work we systematically review the recent advancements in software engineering with language models, covering 70+ models, 40+ evaluation tasks, 180+ datasets, and 900 relate…
Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System
Jun Huang, Yang Yang, Hang Yu +2
Microservice architecture has sprung up over recent years for managing enterprise applications, due to its ability to independently deploy and scale services. Despite its benefits,…
BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basis
Zelin Ni, Hang Yu, Shizhan Liu +2
Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be ef…
CodeFuse-13B: A Pretrained Multi-lingual Code Large Language Model
Peng Di, Jianguo Li, Hang Yu +35
Code Large Language Models (Code LLMs) have gained significant attention in the industry due to their wide applications in the full lifecycle of software engineering. However, the…