4 papers
How Many Different Outputs Can a Transformer Generate?
Maxime Meyer, Mario Michelessa, Caroline Chaux +1
We study how we can leverage only a handful of characteristics of a transformer's architecture to closely predict the number of different sequences it can output, both qualitativel…
Deep Unfolding with Approximated Computations for Rapid Optimization
Dvir Avrahami, Amit Milstein, Caroline Chaux +2
Optimization-based solvers play a central role in a wide range of signal processing and communication tasks. However, their applicability in latency-sensitive systems is limited by…
Memory Limitations of Prompt Tuning in Transformers
Maxime Meyer, Mario Michelessa, Caroline Chaux +1
Despite the empirical success of prompt tuning in adapting pretrained language models to new tasks, theoretical analyses of its capabilities remain limited. Existing theoretical wo…
Unveiling and Mitigating Adversarial Vulnerabilities in Iterative Optimizers
Elad Sofer, Tomer Shaked, Caroline Chaux +1
Machine learning (ML) models are often sensitive to carefully crafted yet seemingly unnoticeable perturbations. Such adversarial examples are considered to be a property of ML mode…