33 citations · 76 across the 8 of their papers we have counts for
9 papers
Attention Lens: A Tool for Mechanistically Interpreting the Attention Head Information Retrieval Mechanism
Mansi Sakarvadia, Arham Khan, Aswathy Ajith +5
Transformer-based Large Language Models (LLMs) are the state-of-the-art for natural language tasks. Recent work has attempted to decode, by reverse engineering the role of linear l…
Optimizing Scientific Data Transfer on Globus with Error-bounded Lossy Compression
Yuanjian Liu, Sheng Di, Kyle Chard +2
The increasing volume and velocity of science data necessitate the frequent movement of enormous data volumes as part of routine research activities. As a result, limited wide-area…
PSI/J: A Portable Interface for Submitting, Monitoring, and Managing Jobs
Mihael Hategan-Marandiuc, Andre Merzky, Nicholson Collier +10
It is generally desirable for high-performance computing (HPC) applications to be portable between HPC systems, for example to make use of more performant hardware, make effective…
Accelerating Communications in Federated Applications with Transparent Object Proxies
J. Gregory Pauloski, Valerie Hayot-Sasson, Logan Ward +5
Advances in networks, accelerators, and cloud services encourage programmers to reconsider where to compute -- such as when fast networks make it cost-effective to compute on remot…
Hierarchical and Decentralised Federated Learning
Omer Rana, Theodoros Spyridopoulos, Nathaniel Hudson +4
Federated learning has shown enormous promise as a way of training ML models in distributed environments while reducing communication costs and protecting data privacy. However, th…
funcX: Federated Function as a Service for Science
Zhuozhao Li, Ryan Chard, Yadu Babuji +9
funcX is a distributed function as a service (FaaS) platform that enables flexible, scalable, and high performance remote function execution. Unlike centralized FaaS systems, funcX…
Playing catch-up in building an open research commons
Philip E. Bourne, Vivien Bonazzi, Amy Brand +12
On August 2, 2021 a group of concerned scientists and US funding agency and federal government officials met for an informal discussion to explore the value and need for a well-coo…
The Diminishing Returns of Masked Language Models to Science
Zhi Hong, Aswathy Ajith, Gregory Pauloski +3
Transformer-based masked language models such as BERT, trained on general corpora, have shown impressive performance on downstream tasks. It has also been demonstrated that the dow…
Ultrafast Focus Detection for Automated Microscopy
Maksim Levental, Ryan Chard, Kyle Chard +2
Technological advancements in modern scientific instruments, such as scanning electron microscopes (SEMs), have significantly increased data acquisition rates and image resolutions…