2 papers
cs.LG2024
Theory, Analysis, and Best Practices for Sigmoid Self-Attention
Jason Ramapuram, Federico Danieli, Eeshan Dhekane +8
Attention is a key part of the transformer architecture. It is a sequence-to-sequence mapping that transforms each sequence element into a weighted sum of values. The weights are t…
physics.optics2021
A Framework for Discovering Optimal Solutions in Photonic Inverse Design
Jagrit Digani, Phillip Hon, Artur R. Davoyan
Photonic inverse design has emerged as an indispensable engineering tool for complex optical systems. In many instances it is important to optimize for both material and geometry c…