1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2025
Attention with Trained Embeddings Provably Selects Important Tokens
Diyuan Wu, Aleksandr Shevchenko, Samet Oymak +1
Token embeddings play a crucial role in language modeling but, despite this practical relevance, their theoretical understanding remains limited. Our paper addresses the gap by cha…
cs.LG2019★ 1 cited
Scaling Matters in Deep Structured-Prediction Models
Aleksandr Shevchenko, Anton Osokin
Deep structured-prediction energy-based models combine the expressive power of learned representations and the ability of embedding knowledge about the task at hand into the system…