497 citations
- Georgia Institute of TechnologyUS50 papers
- Microsoft (United States)US4 papers
- Carnegie Mellon UniversityUS3 papers
- Emory UniversityUS3 papers
- Massachusetts Institute of TechnologyUS3 papers
- Microsoft Research (United Kingdom)GB3 papers
- University of California, BerkeleyUS3 papers
- University of California San DiegoUS3 papers
- University of Wisconsin–MadisonUS3 papers
- Google (United States)US2 papers
- IBM (United States)US2 papers
- Princeton UniversityUS2 papers
53 papers
Stratum: System-Hardware Co-Design with Tiered Monolithic 3D-Stackable DRAM for Efficient MoE Serving
Yue Pan, Zihan Xia, Po-Kai Hsu +8
As Large Language Models (LLMs) continue to evolve, Mixture of Experts (MoE) architecture has emerged as a prevailing design for achieving state-of-the-art performance across a wid…
Grid Labeling: Crowdsourcing Task-Specific Importance from Visualizations
Minsuk Chang, Yao Wang, Huichen Will Wang +2
Knowing where people look in visualizations is key to effective design. Yet, existing research primarily focuses on free-viewing-based saliency models - although visual attention i…
Dissecting a Small Artificial Neural Network
Xiguang Yang, Krish Arora, Michael Bachmann
We investigate the loss landscape and backpropagation dynamics of convergence for the simplest possible artificial neural network representing the logical exclusive-OR (XOR) gate.…
An uncertainty-aware Digital Shadow for underground multimodal CO2 storage monitoring
Abhinav Prakash Gahlot, Rafael Orozco, Ziyi Yin +1
Geological Carbon Storage GCS is arguably the only scalable net-negative CO2 emission technology available While promising subsurface complexities and heterogeneity of reservoir pr…
Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation
Aeree Cho, Grace C. Kim, Alexander Karpekov +6
The Transformer architecture underpins modern large language models powering state-of-the-art text generation and AI applications. However, its complexity makes it difficult for no…
Roadmap for Animate Matter
Giorgio Volpe, Nuno A. M. Araújo, Maria Guix +37
Humanity has long sought inspiration from nature to innovate materials and devices. As science advances, nature-inspired materials are becoming part of our lives. Animate materials…