7 citations · 19 across the 27 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Deep Tensor Network
Yifan Zhang
The quadratic complexity of dot-product attention introduced in Transformer remains a fundamental bottleneck impeding the progress of foundation models toward unbounded context len…
cs.CV2023★ 2 cited
Can pre-trained models assist in dataset distillation?
Yao Lu, Xuguang Chen, Yuchen Zhang +7
Dataset Distillation (DD) is a prominent technique that encapsulates knowledge from a large-scale original dataset into a small synthetic dataset for efficient training. Meanwhile,…