1 citations · 1 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Gradient descent with generalized Newton's method
Zhiqi Bu, Shiyun Xu
We propose the generalized Newton's method (GeN) -- a Hessian-informed approach that applies to any optimizer such as SGD and Adam, and covers the Newton-Raphson method as a sub-ca…
cs.LG2024
MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation
Lu Li, Tianyu Zhang, Zhiqi Bu +7
Model merging has emerged as an effective approach to combine multiple single-task models into a multitask model. This process typically involves computing a weighted average of th…