67 citations · 128 across the 14 of their papers we have counts for
14 papers
Protecting User Privacy in Remote Conversational Systems: A Privacy-Preserving framework based on text sanitization
Zhigang Kan, Linbo Qiao, Hao Yu +3
Large Language Models (LLMs) are gaining increasing attention due to their exceptional performance across numerous tasks. As a result, the general public utilize them as an influen…
TAPS: Topology-Aware Intra-Operator Parallelism Strategy Searching Algorithm for Deep Neural Networks
Peng Liang, Hao Zheng, Teng Su +2
TAPS is a Topology-Aware intra-operator Parallelism strategy Searching algorithm that generates intra-operator parallelism strategies by considering both intra-node and inter-node…
A Unified Generative Framework based on Prompt Learning for Various Information Extraction Tasks
Zhigang Kan, Linhui Feng, Zhangyue Yin +3
Prompt learning is an effective paradigm that bridges gaps between the pre-training tasks and the corresponding downstream applications. Approaches based on this paradigm have achi…
Merak: An Efficient Distributed DNN Training Framework with Automated 3D Parallelism for Giant Foundation Models
Zhiquan Lai, Shengwei Li, Xudong Tang +5
Foundation models are becoming the dominant deep learning technologies. Pretraining a foundation model is always time-consumed due to the large scale of both the model parameter an…
DELTA: Dynamically Optimizing GPU Memory beyond Tensor Recomputation
Yu Tang, Chenyu Wang, Yufan Zhang +5
The further development of deep neural networks is hampered by the limited GPU memory resource. Therefore, the optimization of GPU memory resources is highly demanded. Swapping and…
Inertial Proximal Deep Learning Alternating Minimization for Efficient Neutral Network Training
Linbo Qiao, Tao Sun, Hengyue Pan +1
In recent years, the Deep Learning Alternating Minimization (DLAM), which is actually the alternating minimization applied to the penalty form of the deep neutral networks training…
Event Arguments Extraction via Dilate Gated Convolutional Neural Network with Enhanced Local Features
Zhigang Kan, Linbo Qiao, Sen Yang +2
Event Extraction plays an important role in information-extraction to understand the world. Event extraction could be split into two subtasks: one is event trigger extraction, the…
P-ADMMiRNN: Training RNN with Stable Convergence via An Efficient and Paralleled ADMM Approach
Yu Tang, Zhigang Kan, Dequan Sun +4
It is hard to train Recurrent Neural Network (RNN) with stable convergence and avoid gradient vanishing and exploding problems, as the weights in the recurrent unit are repeated fr…
An Efficient ADMM-Based Algorithm to Nonconvex Penalized Support Vector Machines
Lei Guan, Linbo Qiao, Dongsheng Li +3
Support vector machines (SVMs) with sparsity-inducing nonconvex penalties have received considerable attentions for the characteristics of automatic classification and variable sel…
On the Iteration Complexity Analysis of Stochastic Primal-Dual Hybrid Gradient Approach with High Probability
Linbo Qiao, Tianyi Lin, Qi Qin +1
In this paper, we propose a stochastic Primal-Dual Hybrid Gradient (PDHG) approach for solving a wide spectrum of regularized stochastic minimization problems, where the regulariza…
An Incremental Path-Following Splitting Method for Linearly Constrained Nonconvex Nonsmooth Programs
Linbo Qiao, Wei Liu, Steven Hoi
The stationary point of Problem 2 is NOT the stationary point of Problem 1. We are sorry and we are working on fixing this error.
Learning for Disparity Estimation through Feature Constancy
Zhengfa Liang, Yiliu Feng, Yulan Guo +5
Stereo matching algorithms usually consist of four steps, including matching cost calculation, matching cost aggregation, disparity calculation, and disparity refinement. Existing…
Stochastic Primal-Dual Proximal ExtraGradient Descent for Compositely Regularized Optimization
Tianyi Lin, Linbo Qiao, Teng Zhang +2
We consider a wide range of regularized stochastic minimization problems with two regularization terms, one of which is composed with a linear function. This optimization model abs…
Semantic tracking: Single-target tracking with inter-supervised convolutional networks
Jingjing Xiao, Qiang Lan, Linbo Qiao +1
This article presents a semantic tracker which simultaneously tracks a single target and recognises its category. In general, it is hard to design a tracking model suitable for all…