6 citations · 7 across the 7 of their papers we have counts for
4 papers · 1 filter
Task-Aware QUBO Allocation for Mixed-Precision Quantization
Osama Orabi, Artur Zagitov, Hadi Salloum +2
Mixed-precision quantization requires discrete allocation of weight and activation bit-widths, followed by recovery of the selected network. We develop a task-aware quadratic uncon…
Quantum-Inspired Episode Selection for Monte Carlo Reinforcement Learning via QUBO Optimization
Hadi Salloum, Ali Jnadi, Yaroslav Kholodov +1
Monte Carlo (MC) reinforcement learning suffers from high sample complexity, especially in environments with sparse rewards, large state spaces, and correlated trajectories. We add…
Local Methods with Adaptivity via Scaling
Savelii Chezhegov, Sergey Skorik, Nikolas Khachaturov +5
The rapid development of machine learning and deep learning has introduced increasingly complex optimization challenges that must be addressed. Indeed, training modern, advanced mo…
Activations and Gradients Compression for Model-Parallel Training
Mikhail Rudakov, Aleksandr Beznosikov, Yaroslav Kholodov +1
Large neural networks require enormous computational clusters of machines. Model-parallel training, when the model architecture is partitioned sequentially between workers, is a po…