3 citations · 7 across the 13 of their papers we have counts for
5 papers · 1 filter
Attention Lens: A Tool for Mechanistically Interpreting the Attention Head Information Retrieval Mechanism
Mansi Sakarvadia, Arham Khan, Aswathy Ajith +5
Transformer-based Large Language Models (LLMs) are the state-of-the-art for natural language tasks. Recent work has attempted to decode, by reverse engineering the role of linear l…
Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models
Mansi Sakarvadia, Aswathy Ajith, Arham Khan +5
Answering multi-hop reasoning questions requires retrieving and synthesizing information from diverse sources. Large Language Models (LLMs) struggle to perform such reasoning consi…
Adversarial Predictions of Data Distributions Across Federated Internet-of-Things Devices
Samir Rajani, Dario Dematties, Nathaniel Hudson +4
Federated learning (FL) is increasingly becoming the default approach for training machine learning models across decentralized Internet-of-Things (IoT) devices. A key advantage of…
Accelerating Communications in Federated Applications with Transparent Object Proxies
J. Gregory Pauloski, Valerie Hayot-Sasson, Logan Ward +5
Advances in networks, accelerators, and cloud services encourage programmers to reconsider where to compute -- such as when fast networks make it cost-effective to compute on remot…
Hierarchical and Decentralised Federated Learning
Omer Rana, Theodoros Spyridopoulos, Nathaniel Hudson +4
Federated learning has shown enormous promise as a way of training ML models in distributed environments while reducing communication costs and protecting data privacy. However, th…