2 citations · 2 across the 7 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Enhanced QKNorm normalization for neural transformers with the Lp norm
Ezequiel Lopez-Rubio, Javier Montes-Perez, Esteban Jose Palomo
The normalization of query and key vectors is an essential part of the Transformer architecture. It ensures that learning is stable regardless of the scale of these vectors. Some n…
cs.LG2025
Alternative positional encoding functions for neural transformers
Ezequiel Lopez-Rubio, Macoris Decena-Gimenez, Rafael Marcos Luque-Baena
A key module in neural transformer-based deep architectures is positional encoding. This module enables a suitable way to encode positional information as input for transformer neu…