From the 1 of 26 linked papers with an AI index.
26 papers
Interpreting Language Model Hidden States at Scale
Jordan Pettyjohn, Mansi Sakarvadia, Nathaniel Hudson +3
Lens methods interpret large language models (LLMs) by mapping intermediate activations to the output vocabulary, revealing how next-token predictions develop through the network.…
Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap
Rafael Ferreira da Silva, Milad Abolhasani, Peter Beaucage +25
The paper updates a community roadmap for autonomous scientific laboratories, emphasizing trust, verification, reproducibility, safety, security, and governance as central challeng…
Towards Transparent Checkpointing with AI-driven Code Generation
Hai Duc Nguyen, Tekin Bicer, Kyle Chard +2
Adding reliable checkpoint/restart support to an MPI scientific application is a time-consuming expert effort that requires deep knowledge of both the application and resilience. W…
StreamGuard: Low-Overhead Resilience for Real-time HPC Data Streams
Hai Duc Nguyen, Bogdan Nicolae, Tekin Bicer +4
Real-time scientific workflows operate on continuous data streams and must produce timely, high-quality results despite executing on complex, failure-prone infrastructure. Hardware…
When More Cores Hurts: The Vector Database Scaling Paradox in HPC
Seth Ockerman, Song Young Oh, Amal Gueroudji +12
Vector databases have been designed and optimized for cloud environments; however, emerging scientific AI workloads (e.g., molecular search, meteorological trajectory detection, an…
Beyond Fixed Budgets: Characterizing the Inelasticity and Limitations of Tree-of-Thought Reasoning Strategies
Atkia Mahila, Avinash Maurya, M. Mustafa Rafique +1
Tree of Thought (ToT) search has become a promising direction for improving the reasoning capabilities of large language models, but deploying these methods in practice raises a qu…