259 citations · 1.2k across the 51 of their papers we have counts for
16 papers · 1 filter
Attention Lens: A Tool for Mechanistically Interpreting the Attention Head Information Retrieval Mechanism
Mansi Sakarvadia, Arham Khan, Aswathy Ajith +5
Transformer-based Large Language Models (LLMs) are the state-of-the-art for natural language tasks. Recent work has attempted to decode, by reverse engineering the role of linear l…
Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models
Mansi Sakarvadia, Aswathy Ajith, Arham Khan +5
Answering multi-hop reasoning questions requires retrieving and synthesizing information from diverse sources. Large Language Models (LLMs) struggle to perform such reasoning consi…
Adversarial Predictions of Data Distributions Across Federated Internet-of-Things Devices
Samir Rajani, Dario Dematties, Nathaniel Hudson +4
Federated learning (FL) is increasingly becoming the default approach for training machine learning models across decentralized Internet-of-Things (IoT) devices. A key advantage of…
nelli: a lightweight frontend for MLIR
Maksim Levental, Alok Kamatar, Ryan Chard +2
Multi-Level Intermediate Representation (MLIR) is a novel compiler infrastructure that aims to provide modular and extensible components to facilitate building domain specific comp…
NSF RESUME HPC Workshop: High-Performance Computing and Large-Scale Data Management in Service of Epidemiological Modeling
Abby Stevens, Jonathan Ozik, Kyle Chard +2
The NSF-funded Robust Epidemic Surveillance and Modeling (RESUME) project successfully convened a workshop entitled "High-performance computing and large-scale data management in s…
Towards a Modular Architecture for Science Factories
Rafael Vescovi, Tobias Ginsburg, Kyle Hippe +14
Advances in robotic automation, high-performance computing (HPC), and artificial intelligence (AI) encourage us to conceive of science factories: large, general-purpose computation…