most citedPRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing cs.LGShow all

2 papers · 1 filter

cs.LG2026

Gefen: Optimized Stochastic Optimizer

Nadav Benedek, Tomer Koren, Ohad Fried

AdamW is a default optimizer for deep learning, but its moment states add two parameter-sized buffers to training memory, increasing the cost of large-scale pretraining. We propose…

cs.LG2024

Impactful Bit-Flip Search on Full-precision Models

Nadav Benedek, Matan Levy, Mahmood Sharif

Neural networks have shown remarkable performance in various tasks, yet they remain susceptible to subtle changes in their input or model parameters. One particularly impactful vul…