activity
20202024
most citedDo We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training

18 citations · 66 across the 17 of their papers we have counts for

collaborators
Showing 2021Show all

5 papers · 1 filter

cs.CV2021

Semantic-Based Few-Shot Learning by Interactive Psychometric Testing

Lu Yin, Vlado Menkovski, Yulong Pei +1

Few-shot classification tasks aim to classify images in query sets based on only a few labeled examples in support sets. Most studies usually assume that each image in a task has a…

cs.LG2021★ 13 cited

Sparse Training via Boosting Pruning Plasticity with Neuroregeneration

Shiwei Liu, Tianlong Chen, Xiaohan Chen +7

Works on lottery ticket hypothesis (LTH) and single-shot network pruning (SNIP) have raised a lot of attention currently on post-training pruning (iterative magnitude pruning), and…

cs.IR2021★ 16 cited

Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation

Yongji Wu, Defu Lian, Neil Zhenqiang Gong +4

Self-attention has become increasingly popular in a variety of sequence modeling tasks from natural language processing to recommendation, due to its effectiveness. However, self-a…

cs.IR2021★ 6 cited

Rethinking Lifelong Sequential Recommendation with Incremental Multi-Interest Attention

Yongji Wu, Lu Yin, Defu Lian +4

Sequential recommendation plays an increasingly important role in many e-commerce services such as display advertisement and online shopping. With the rapid development of these se…

cs.LG2021★ 18 cited

Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training

Shiwei Liu, Lu Yin, Decebal Constantin Mocanu +1

In this paper, we introduce a new perspective on training deep neural networks capable of state-of-the-art performance without the need for the expensive over-parameterization by p…