7 citations · 7 across the 5 of their papers we have counts for
4 papers · 1 filter
Robust Parameter-Efficient LLM Adaptation on Analog Hardware
Jindan Li, Zhaoxian Wu, Tianyi Chen
Analog in-memory computing is a promising platform for on-device execution of large language models because it performs matrix--vector multiplications (MVMs) in memory and in paral…
The Price of Locality: Why Forward-Forward Underperforms Backpropagation?
Zhaoxian Wu, Haichuan Liu, Tianyi Chen
The Forward-Forward Algorithm (FFA) replaces backpropagation (BP) with layer-wise local contrastive objectives, eliminating the backward pass and the need to retain intermediate ac…
Optimization under Persistent State-Dependent Bias: Gradient-based Method and Complexity Analysis
Zhaoxian Wu, Quan Xiao, Tayfun Gokmen +1
This paper studies the convergence of stochastic gradient descent (SGD) when the implemented updates are subject to a persistent and state-dependent bias, in which the desired upda…
Dynamic Symmetric Point Tracking: Tackling Non-ideal Reference in Analog In-memory Training
Quan Xiao, Jindan Li, Zhaoxian Wu +2
Analog in-memory computing (AIMC) performs computation directly within resistive crossbar arrays, offering an energy-efficient platform to scale large vision and language models. H…