output
19942026
Showing cs.LGShow all

135 papers · 1 filter

cs.LG2025

Federated Majorize-Minimization: Beyond Parameter Aggregation

Aymeric Dieuleveut, Gersende Fort, Mahmoud Hegazy +1

This paper proposes a unified approach for designing stochastic optimization algorithms that robustly scale to the federated learning setting. Our work studies a class of Majorize-…

cs.LG2025★ 2 cited

A Unified Online-Offline Framework for Co-Branding Campaign Recommendations

Xiangxiang Dai, Xiaowei Sun, Jinhang Zuo +2

Co-branding has become a vital strategy for businesses aiming to expand market reach within recommendation systems. However, identifying effective cross-industry partnerships remai…

cs.LG2025★ 1 cited

Leveraging the Power of Conversations: Optimal Key Term Selection in Conversational Contextual Bandits

Maoli Liu, Zhuohua Li, Xiangxiang Dai +1

Conversational recommender systems proactively query users with relevant "key terms" and leverage the feedback to elicit users' preferences for personalized recommendations. Conver…

cs.LG2025★ 4 cited

A Survey of Graph Transformers: Architectures, Theories and Applications

Chaohao Yuan, Kangfei Zhao, Ercan Engin Kuruoglu +6

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-sm…

cs.LG2025★ 9 cited

A Survey on Inference Optimization Techniques for Mixture of Experts Models

Jiacheng Liu, Peng Tang, Wenfeng Wang +5

The emergence of large-scale Mixture of Experts (MoE) models represents a significant advancement in artificial intelligence, offering enhanced model capacity and computational eff…

cs.LG2025★ 3 cited

Hardware implementation of timely reliable Bayesian decision-making using memristors

Lekai Song, Pengyu Liu, Yang Liu +8

Brains perform decision-making by Bayes theorem. The theorem quantifies events as probabilities and, based on probability rules, renders the decisions. Learning from this, Bayes th…

cs.LG2024★ 2 cited

Fairness without Demographics through Learning Graph of Gradients

Yingtao Luo, Zhixun Li, Qiang Liu +1

Machine learning systems are notoriously prone to biased predictions about certain demographic groups, leading to algorithmic fairness issues. Due to privacy concerns and data qual…

cs.LG2024★ 4 cited

FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation

Ziwei Zhan, Wenkuan Zhao, Yuanqing Li +6

Federated learning (FL) is a collaborative machine learning approach that enables multiple clients to train models without sharing their private data. With the rise of deep learnin…

cs.LG2024★ 2 cited

Defining and Evaluating Physical Safety for Large Language Models

Yung-Chen Tang, Pin-Yu Chen, Tsung-Yi Ho

Large Language Models (LLMs) are increasingly used to control robotic systems such as drones, but their risks of causing physical threats and harm in real-world applications remain…

cs.LG2024★ 3 cited

MCUBERT: Memory-Efficient BERT Inference on Commodity Microcontrollers

Zebin Yang, Renze Chen, Taiqiang Wu +5

In this paper, we propose MCUBERT to enable language models like BERT on tiny microcontroller units (MCUs) through network and scheduling co-optimization. We observe the embedding…

cs.LG2024★ 6 cited

Co-Designing Binarized Transformer and Hardware Accelerator for Efficient End-to-End Edge Deployment

Yuhao Ji, Chao Fang, Shaobo Ma +2

Transformer models have revolutionized AI tasks, but their large size hinders real-world deployment on resource-constrained and latency-critical edge devices. While binarized Trans…

cs.LG2024★ 6 cited

Towards Deeper Understanding of PPR-based Embedding Approaches: A Topological Perspective

Xingyi Zhang, Zixuan Weng, Sibo Wang

Node embedding learns low-dimensional vectors for nodes in the graph. Recent state-of-the-art embedding approaches take Personalized PageRank (PPR) as the proximity measure and fac…

cs.LG2024★ 14 cited

Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task

Huiping Zhuang, Di Fang, Kai Tong +4

In autonomous driving, even a meticulously trained model can encounter failures when facing unfamiliar scenarios. One of these scenarios can be formulated as an online continual le…

cs.LG2024★ 1 cited

CG-FedLLM: How to Compress Gradients in Federated Fune-tuning for Large Language Models

Huiwen Wu, Xiaogang Xu, Deyi Zhang +3

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a coll…

cs.LG2024★ 146 cited

Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods

Yuji Cao, Huan Zhao, Yuheng Cheng +7

With extensive pre-trained knowledge and high-level general capabilities, large language models (LLMs) emerge as a promising avenue to augment reinforcement learning (RL) in aspect…

cs.LG2024★ 1 cited

Analyzing the Variations in Emergency Department Boarding and Testing the Transferability of Forecasting Models across COVID-19 Pandemic Waves in Hong Kong: Hybrid CNN-LSTM approach to quantifying building-level socioecological risk

Eman Leung, Jingjing Guan, Kin On Kwok +6

Emergency department's (ED) boarding (defined as ED waiting time greater than four hours) has been linked to poor patient outcomes and health system performance. Yet, effective for…

cs.LG2024★ 8 cited

Kernel Correlation-Dissimilarity for Multiple Kernel k-Means Clustering

Rina Su, Yu Guo, Caiying Wu +2

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current m…

cs.LG2024★ 45 cited

All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretraining

Haihong Zhao, Aochuan Chen, Xiangguo Sun +2

Large Language Models (LLMs) have revolutionized the fields of computer vision (CV) and natural language processing (NLP). One of the most notable advancements of LLMs is that a si…

cs.LG2023★ 7 cited

Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive Learning

Yifei Zhang, Hao Zhu, Menglin Yang +4

Learning generalizable self-supervised graph representations for downstream tasks is challenging. To this end, Contrastive Learning (CL) has emerged as a leading approach. The embe…

cs.LG2023★ 16 cited

Power-Enhanced Residual Network for Function Approximation and Physics-Informed Inverse Problems

Amir Noorizadegan, D. L. Young, Y. C. Hon +1

In this study, we investigate how the updating of weights during forward operation and the computation of gradients during backpropagation impact the optimization process, training…

cs.LG2023★ 23 cited

Efficient N:M Sparse DNN Training Using Algorithm, Architecture, and Dataflow Co-Design

Chao Fang, Wei Sun, Aojun Zhou +1

Sparse training is one of the promising techniques to reduce the computational cost of DNNs while retaining high accuracy. In particular, N:M fine-grained structured sparsity, wher…

cs.LG2023★ 23 cited

Dynamic landslide susceptibility mapping over recent three decades to uncover variations in landslide causes in subtropical urban mountainous areas

Peifeng Ma, Li Chen, Chang Yu +2

Landslide susceptibility assessment (LSA) is of paramount importance in mitigating landslide risks. Recently, there has been a surge in the utilization of data-driven methods for p…

cs.LG2023★ 4 cited

HireVAE: An Online and Adaptive Factor Model Based on Hierarchical and Regime-Switch VAE

Zikai Wei, Anyi Rao, Bo Dai +1

Factor model is a fundamental investment tool in quantitative investment, which can be empowered by deep learning to become more flexible and efficient in practical complicated inv…

cs.LG2023

Dynamic Flows on Curved Space Generated by Labeled Data

Xinru Hua, Truyen Nguyen, Tam Le +2

The scarcity of labeled data is a long-standing challenge for many machine learning tasks. We propose our gradient flow method to leverage the existing dataset (i.e., source) to ge…