9 papers
SDG-MoE: Signed Debate Graph Mixture-of-Experts
Stepan Kulibaba, Kirill Labzin, Artem Dzhalilov +4
Sparse MoE models achieve a good balance between capacity and compute by routing each token to a small subset of experts. However, in most MoE architectures, once a token is routed…
KompeteAI: Accelerated Autonomous Multi-Agent System for End-to-End Pipeline Generation for Machine Learning Problems
Stepan Kulibaba, Artem Dzhalilov, Roman Pakhomov +3
Recent Large Language Model (LLM)-based AutoML systems demonstrate impressive capabilities but face significant limitations such as constrained exploration strategies and a severe…
SCOPE: Smooth Convex Optimization for Planned Evolution of Deformable Linear Objects
Ali Jnadi, Hadi Salloum, Yaroslav Kholodov +2
We present SCOPE, a fast and efficient framework for modeling and manipulating deformable linear objects (DLOs). Unlike conventional energy-based approaches, SCOPE leverages convex…
Quantum-Inspired Episode Selection for Monte Carlo Reinforcement Learning via QUBO Optimization
Hadi Salloum, Ali Jnadi, Yaroslav Kholodov +1
Monte Carlo (MC) reinforcement learning suffers from high sample complexity, especially in environments with sparse rewards, large state spaces, and correlated trajectories. We add…
UCB-type Algorithm for Budget-Constrained Expert Learning
Ilgam Latypov, Alexandra Suvorikova, Alexey Kroshnin +2
In many modern applications, a system must dynamically choose between several adaptive learning algorithms that are trained online. Examples include model selection in streaming en…
Exploring Applications of State Space Models and Advanced Training Techniques in Sequential Recommendations: A Comparative Study on Efficiency and Performance
Mark Obozov, Makar Baderko, Stepan Kulibaba +2
Recommender systems aim to estimate the dynamically changing user preferences and sequential dependencies between historical user behaviour and metadata. Although transformer-based…