3 papers
math.OC2026
Continuous-Time Analysis for Minimax and Bilevel Problems
Hyunwoo Lee, Jeongyeol Kwon, Dohyun Kwon
We study single-loop gradient-flow dynamics for nested optimization, where the outer variable evolves while auxiliary variables track the inner solution map. While existing analyse…
cs.LG2025
Beyond Gaussian Initializations: Signal Preserving Weight Initialization for Odd-Sigmoid Activations
Hyunwoo Lee, Hayoung Choi, Hyunju Kim
Activation functions critically influence trainability and expressivity, and recent work has therefore explored a broad range of nonlinearities. However, widely used Gaussian i.i.d…
cs.LG2025
Robust Weight Initialization for Tanh Neural Networks with Fixed Point Analysis
Hyunwoo Lee, Hayoung Choi, Hyunju Kim
As a neural network's depth increases, it can improve generalization performance. However, training deep networks is challenging due to gradient and signal propagation issues. To a…