11 papers
CLIMP: Contrastive Language-Image Mamba Pretraining
Nimrod Shabtay, Itamar Zimerman, Eli Schwartz +1
Contrastive Language-Image Pre-training (CLIP) relies on Vision Transformers whose attention mechanism is susceptible to spurious correlations, and scales quadratically with resolu…
Power-Softmax: Towards Secure LLM Inference over Encrypted Data
Itamar Zimerman, Allon Adir, Ehud Aharoni +7
Modern cryptographic methods for implementing privacy-preserving LLMs such as \gls{HE} require the LLMs to have a polynomial form. Forming such a representation is challenging beca…
TensorLens: End-to-End Transformer Analysis via High-Order Attention Tensors
Ido Andrew Atad, Itamar Zimerman, Shahar Katz +1
Attention matrices are fundamental to transformer research, supporting a broad range of applications including interpretability, visualization, manipulation, and distillation. Yet,…
Neural Brain Fields: A NeRF-Inspired Approach for Generating Nonexistent EEG Electrodes
Shahar Ain Kedem, Itamar Zimerman, Eliya Nachmani
Electroencephalography (EEG) data present unique modeling challenges because recordings vary in length, exhibit very low signal to noise ratios, differ significantly across partici…
Efficient Decoding Methods for Language Models on Encrypted Data
Matan Avitan, Moran Baruch, Nir Drucker +2
Large language models (LLMs) power modern AI applications, but processing sensitive data on untrusted servers raises privacy concerns. Homomorphic encryption (HE) enables computati…
Differential Mamba
Nadav Schneider, Itamar Zimerman, Eliya Nachmani
Sequence models like Transformers and RNNs often overallocate attention to irrelevant context, leading to noisy intermediate representations. This degrades LLM capabilities by prom…