Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Impact of Layer Norm on Memorization and Generalization in Transformers
Rishi Singhal, Jung-Eun Kim
Layer Normalization (LayerNorm) is one of the fundamental components in transformers that stabilizes training and improves optimization. In recent times, Pre-LayerNorm transformers…
cs.LG2025
Explaining How Quantization Disparately Skews a Model
Abhimanyu Bellam, Jung-Eun Kim
Post Training Quantization (PTQ) is widely adopted due to its high compression capacity and speed with minimal impact on accuracy. However, we observed that disparate impacts are e…
cs.LG2025
Severing Spurious Correlations with Data Pruning
Varun Mulchandani, Jung-Eun Kim
Deep neural networks have been shown to learn and rely on spurious correlations present in the data that they are trained on. Reliance on such correlations can cause these networks…