101 citations · 230 across the 19 of their papers we have counts for
16 papers · 1 filter
Exponential Graph is Provably Efficient for Decentralized Deep Training
Bicheng Ying, Kun Yuan, Yiming Chen +3
Decentralized SGD is an emerging training method for deep learning known for its much less (thus faster) communication per iteration, which relaxes the averaging step in parallel S…
Accelerating Gossip SGD with Periodic Global Averaging
Yiming Chen, Kun Yuan, Yingya Zhang +3
Communication overhead hinders the scalability of large-scale distributed training. Gossip SGD, where each node averages only with its neighbors, is more communication-efficient th…
OR-Net: Pointwise Relational Inference for Data Completion under Partial Observation
Qianyu Feng, Linchao Zhu, Bang Zhang +2
Contemporary data-driven methods are typically fed with full supervision on large-scale datasets which limits their applicability. However, in the actual systems with limitations s…
DecentLaM: Decentralized Momentum SGD for Large-batch Deep Training
Kun Yuan, Yiming Chen, Xinmeng Huang +4
The scale of deep learning nowadays calls for efficient distributed training algorithms. Decentralized momentum SGD (DmSGD), in which each node averages only with its neighbors, is…
Learning Position and Target Consistency for Memory-based Video Object Segmentation
Li Hu, Peng Zhang, Bang Zhang +3
This paper studies the problem of semi-supervised video object segmentation(VOS). Multiple works have shown that memory-based approaches can be effective for video object segmentat…
Multiple Object Tracking with Correlation Learning
Qiang Wang, Yun Zheng, Pan Pan +1
Recent works have shown that convolutional networks have substantially improved the performance of multiple object tracking by simultaneously learning detection and appearance feat…
Few-Shot Incremental Learning with Continually Evolved Classifiers
Chi Zhang, Nan Song, Guosheng Lin +3
Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge…
Self-supervised Video Representation Learning by Context and Motion Decoupling
Lianghua Huang, Yu Liu, Bin Wang +3
A key challenge in self-supervised video representation learning is how to effectively capture motion information besides context bias. While most existing works implicitly achieve…
Large-Scale Training System for 100-Million Classification at Alibaba
Liuyihan Song, Pan Pan, Kang Zhao +5
In the last decades, extreme classification has become an essential topic for deep learning. It has achieved great success in many areas, especially in computer vision and natural…
Train a One-Million-Way Instance Classifier for Unsupervised Visual Representation Learning
Yu Liu, Lianghua Huang, Pan Pan +3
This paper presents a simple unsupervised visual representation learning method with a pretext task of discriminating all images in a dataset using a parametric, instance-level cla…
Distribution Adaptive INT8 Quantization for Training CNNs
Kang Zhao, Sida Huang, Pan Pan +4
Researches have demonstrated that low bit-width (e.g., INT8) quantization can be employed to accelerate the inference process. It makes the gradient quantization very promising sin…
Fashion Focus: Multi-modal Retrieval System for Video Commodity Localization in E-commerce
Yanhao Zhang, Qiang Wang, Pan Pan +4
Nowadays, live-stream and short video shopping in E-commerce have grown exponentially. However, the sellers are required to manually match images of the selling products to the tim…
Visual Search at Alibaba
Yanhao Zhang, Pan Pan, Yun Zheng +4
This paper introduces the large scale visual search algorithm and system infrastructure at Alibaba. The following challenges are discussed under the E-commercial circumstance at Al…
Virtual ID Discovery from E-commerce Media at Alibaba: Exploiting Richness of User Click Behavior for Visual Search Relevance
Yanhao Zhang, Pan Pan, Yun Zheng +4
Visual search plays an essential role for E-commerce. To meet the search demands of users and promote shopping experience at Alibaba, visual search relevance of real-shot images is…
Large-Scale Visual Search with Binary Distributed Graph at Alibaba
Kang Zhao, Pan Pan, Yun Zheng +5
Graph-based approximate nearest neighbor search has attracted more and more attentions due to its online search advantages. Numbers of methods studying the enhancement of speed and…
Large Scale Long-tailed Product Recognition System at Alibaba
Xiangzeng Zhou, Pan Pan, Yun Zheng +2
A practical large scale product recognition system suffers from the phenomenon of long-tailed imbalanced training data under the E-commercial circumstance at Alibaba. Besides produ…