2 citations · 2 across the 3 of their papers we have counts for
3 papers
cs.LG2026
The Energy Consumption of Transformer Fine-Tuning: A Roofline-Inspired Scaling Model
Mansour Zoubeirou a Mayaki
Transformer-based models underpin modern natural language processing but incur rapidly growing computational and energy costs. As training scales in both model size and parallelism…
cs.LG2026
Generalization and Scaling Laws for Mixture-of-Experts Transformers
Mansour Zoubeirou a Mayaki
We develop a theory of generalization and scaling for Mixture-of-Experts (MoE) Transformers that cleanly separates \emph{active} per-input capacity from routing combinatorics. By c…
cs.LG2022★ 2 cited
Multiple Inputs Neural Networks for Medicare fraud Detection
Mansour Zoubeirou A Mayaki, Michel Riveill
Medicare fraud results in considerable losses for governments and insurance companies and results in higher premiums from clients. Medicare fraud costs around 13 billion euros in E…