activity
20222026
most citedPushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

11 citations · 20 across the 13 of their papers we have counts for

collaborators
Showing cs.LGShow all

5 papers · 1 filter

cs.LG2026

SimMerge: Learning to Select Merge Operators from Similarity Signals

Oliver Bolton, Aakanksha, Arash Ahmadian +3

Model merging combines multiple models into a single model with aggregated capabilities, making it a powerful tool for large language model (LLM) development. However, scaling mode…

cs.LG2023

-models: Effective Decision-Aware Reinforcement Learning with Latent Models

Claas A Voelcker, Arash Ahmadian, Romina Abachi +2

The idea of decision-aware model learning, that models should be accurate where it matters for decision-making, has gained prominence in model-based reinforcement learning. While p…

cs.LG2023★ 5 cited

Intriguing Properties of Quantization at Scale

Arash Ahmadian, Saurabh Dash, Hongyu Chen +5

Emergent properties have been widely adopted as a term to describe behavior not present in smaller models but observed in larger models. Recent work suggests that the trade-off inc…

cs.LG2023

Pseudo-Inverted Bottleneck Convolution for DARTS Search Space

Arash Ahmadian, Louis S. P. Liu, Yue Fei +2

Differentiable Architecture Search (DARTS) has attracted considerable attention as a gradient-based neural architecture search method. Since the introduction of DARTS, there has be…

cs.LG2022★ 1 cited

Subspace Learning for Feature Selection via Rank Revealing QR Factorization: Unsupervised and Hybrid Approaches with Non-negative Matrix Factorization and Evolutionary Algorithm

Amir Moslemi, Arash Ahmadian

The selection of most informative and discriminative features from high-dimensional data has been noticed as an important topic in machine learning and data engineering. Using matr…