11 papers
AgentIR: A Workload-Adaptive Cascade Retrieval Substrate for Long-Term Conversational Memory
Aojie Yuan, Haiyue Zhang, Shahin Nazarian
Long-term conversational memory is a retrieval workload classical IR was not built for: the index grows during the query stream, query types shift intra-session, and the latency bu…
ERMoE: Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization
Anzhe Cheng, Shukai Duan, Shixuan Li +8
Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's inter…
POET: Power-Oriented Evolutionary Tuning for LLM-Based RTL PPA Optimization
Heng Ping, Peiyu Zhang, Zhenkun Wang +5
Applying large language models (LLMs) to RTL code optimization for improved power, performance, and area (PPA) faces two key challenges: ensuring functional correctness of optimize…
EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts
Anzhe Cheng, Shukai Duan, Shixuan Li +5
The relentless scaling of deep learning models has led to unsustainable computational demands, positioning Mixture-of-Experts (MoE) architectures as a promising path towards greate…
SuperSNN: A Hardware-Aware Framework for Physically Realizable, High-Performance Superconducting Spiking Neural Network Chips
Changxu Song, Arda Caliskan, Beyza Zeynep Ucpinar +5
Despite numerous proposed designs for superconducting neural networks (SNNs), most have overlooked practical fabrication constraints, leading to implementations limited to only a f…
Eigen Neural Network: Unlocking Generalizable Vision with Eigenbasis
Anzhe Cheng, Chenzhong Yin, Mingxi Cheng +3
The remarkable success of Deep Neural Networks(DNN) is driven by gradient-based optimization, yet this process is often undermined by its tendency to produce disordered weight stru…