Zhao Song

most citedBeyond Linear Approximations: A Novel Pruning Approach for Attention Matrix

3 citations · 33 across the 45 of their papers we have counts for

collaborators

Showing cs.DSShow all

3 papers · 1 filter

cs.DS2024★ 2 cited

Quantum Speedups for Approximating the John Ellipsoid

Xiaoyu Li, Zhao Song, Junwei Yu

In 1948, Fritz John proposed a theorem stating that every convex body has a unique maximal volume inscribed ellipsoid, known as the John ellipsoid. The John ellipsoid has become fu…

cs.DS2024★ 2 cited

A Tighter Complexity Analysis of SparseGPT

Xiaoyu Li, Yingyu Liang, Zhenmei Shi +1

In this work, we improved the analysis of the running time of SparseGPT [Frantar, Alistarh ICML 2023] from $O (d^{3})$ to $O (d^{ω} + d^{2 + a + o (1)} + d^{1 + ω (1, 1, a) - a})$ for any $a \in […

cs.DS2024★ 3 cited

Fast John Ellipsoid Computation with Differential Privacy Optimization

Xiaoyu Li, Yingyu Liang, Zhenmei Shi +2

Determining the John ellipsoid - the largest volume ellipsoid contained within a convex polytope - is a fundamental problem with applications in machine learning, optimization, and…