4 citations · 7 across the 17 of their papers we have counts for
10 papers · 1 filter
Academia x Industry: The Role of Fundamentals for Silicon in an AI Native Era
Vincent T. Lee, Armin Alaghi, Carole-Jean Wu +5
Agentic AI is set to become one of the most transformational technologies in generations and materially change how we approach silicon design and engineering. The impact is being f…
The Hyperscale Lottery: How State-Space Models Have Sacrificed Edge Efficiency
Robin Geens, Jonas De Schouwer, Marian Verhelst +1
The Hardware Lottery posits that research directions are dictated by available silicon compute platforms. We identify a derivative phenomenon, the Hyperscale Lottery, where model a…
Heterogeneous Memory Design Exploration for AI Accelerators with a Gain Cell Memory Compiler
Xinxin Wang, Lixian Yan, Shuhan Liu +10
As memory increasingly dominates system cost and energy, heterogeneous on-chip memory systems that combine technologies with complementary characteristics are becoming essential. G…
P3-LLM: An Integrated NPU-PIM Accelerator for Edge LLM Inference Using Hybrid Numerical Formats
Yuzong Chen, Chao Fang, Xilai Dai +4
The substantial memory bandwidth and computational demands of large language models (LLMs) present critical challenges for efficient inference. To tackle this, the literature has e…
The Future of Memory: Limits and Opportunities
Samuel Dayo, Shuhan Liu, Peijing Li +5
Memory latency, bandwidth, capacity, and energy increasingly limit performance. In this paper, we reconsider proposed system architectures that consist of huge (many-terabyte to pe…
Towards Memory Specialization: A Case for Long-Term and Short-Term RAM
Peijing Li, Muhammad Shahir Abdurraman, Rachel Cleaveland +6
Both SRAM and DRAM have stopped scaling: there is no technical roadmap to reduce their cost (per byte/GB). As a result, memory now dominates system cost. This paper argues for a pa…