4 papers
Hybrid Mamba-Transformer Decoder for Error-Correcting Codes
Shy-el Cohen, Yoni Choukroun, Eliya Nachmani
We introduce a novel deep learning method for decoding error correction codes based on the Mamba architecture, enhanced with Transformer layers. Our approach proposes a hybrid deco…
Adaptive Consensus Gradients Aggregation for Scaled Distributed Training
Yoni Choukroun, Shlomi Azoulay, Pavel Kisilev
Distributed machine learning has recently become a critical paradigm for training large models on vast datasets. We examine the stochastic optimization problem for deep learning wi…
Factor Graph Optimization of Error-Correcting Codes for Belief Propagation Decoding
Yoni Choukroun, Lior Wolf
The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. As near capacity-approaching codes, Low-Densi…
Accelerating Error Correction Code Transformers
Matan Levy, Yoni Choukroun, Lior Wolf
Error correction codes (ECC) are crucial for ensuring reliable information transmission in communication systems. Choukroun & Wolf (2022b) recently introduced the Error Correction…