2 papers
cs.LG2025
Hysteresis Activation Function for Efficient Inference
Moshe Kimhi, Idan Kashani, Avi Mendelson +1
The widely used ReLU is favored for its hardware efficiency, {as the implementation at inference is a one bit sign case,} yet suffers from issues such as the ``dying ReLU'' problem…
cs.CL2025
Representing LLMs in Prompt Semantic Task Space
Idan Kashani, Avi Mendelson, Yaniv Nemcovsky
Large language models (LLMs) achieve impressive results over various tasks, and ever-expanding public repositories contain an abundance of pre-trained models. Therefore, identifyin…