2 papers
cs.AI2026
Qrita: High-performance Top-k and Top-p using Pivot-based Truncation and Selection
Jongseok Park, Sunga Kim, Alvin Cheung +1
Despite their importance in model sampling, efficient implementation of Top-k and Top-p algorithms for large vocabularies remains a significant challenge. Existing approaches often…
cs.LG2026
Uncovering Intra-expert Activation Sparsity for Efficient Mixture-of-Expert Model Execution
Jongseok Park, Sunga Kim, Zhenyu Gu +2
Mixture of Experts (MoE) architecture has become the standard for state-of-the-art large language models, owing to its computational efficiency through sparse expert activation. Ho…