4 papers
Breaking the Bubble: Asynchronous Pipeline Parallel Training with Bounded Weight Inconsistency
Itay Elam, Eliron Rahimi, Avi Mendelson +1
Pipeline parallelism is essential for training large neural networks, but existing schedules trade off throughput, memory, and optimization consistency. Synchronous pipelines prese…
Step-Wise Refusal Dynamics in Autoregressive and Diffusion Language Models
Eliron Rahimi, Elad Hirshel, Rom Himelstein +3
Diffusion language models (DLMs) have recently emerged as a competitive alternative to autoregressive (AR) models, offering parallel decoding, competitive generation quality, and i…
Reconstructing Protected Biometric Templates from Binary Authentication Results
Eliron Rahimi, Margarita Osadchy, Orr Dunkelman
Biometric data is considered to be very private and highly sensitive. As such, many methods for biometric template protection were considered over the years -- from biohashing and…
SCART: Simulation of Cyber Attacks for Real-Time
Eliron Rahimi, Kfir Girstein, Roman Malits +1
Real-Time systems are essential for promptly responding to external stimuli and completing tasks within predefined time constraints. Ensuring high reliability and robust security i…